-- Logs begin at Thu 2022-05-26 18:14:50 UTC, end at Thu 2022-05-26 20:00:42 UTC. -- May 26 19:26:52.854692 dv-cinder-825492-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 19:26:52.864179 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 19:26:52 2022] *** May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: nodename: dv-cinder-825492-17-iscsi May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: machine: x86_64 May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: clock source: unix May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: pcre jit disabled May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: detected number of CPU cores: 4 May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: current working directory: / May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: detected binary path: /usr/bin/uwsgi-core May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: your processes number limit is 47680 May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: your memory page size is 4096 bytes May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: detected max file descriptor number: 2048 May 26 19:26:52.866158 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: lock engine: pthread robust mutexes May 26 19:26:52.866989 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: thunder lock: enabled May 26 19:26:52.866989 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 19:26:52.866989 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 19:26:52.911547 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: Python main interpreter initialized at 0x564c7a7a69c0 May 26 19:26:52.911547 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: python threads support enabled May 26 19:26:52.911547 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: your server socket listen backlog is limited to 100 connections May 26 19:26:52.911547 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: your mercy for graceful operations on workers is 90 seconds May 26 19:26:52.911925 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: mapped 403077 bytes (393 KB) for 2 cores May 26 19:26:52.911991 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: *** Operational MODE: preforking *** May 26 19:26:52.912277 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: *** uWSGI is running in multiple interpreter mode *** May 26 19:26:52.912277 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: spawned uWSGI master process (pid: 103936) May 26 19:26:52.912451 dv-cinder-825492-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 19:26:52.914976 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: spawned uWSGI worker 1 (pid: 103939, cores: 1) May 26 19:26:52.914976 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: spawned uWSGI worker 2 (pid: 103940, cores: 1) May 26 19:26:52.915920 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 19:26:54.101435 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 19:26:54.102082 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 19:26:54.826864 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:26:54.826864 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: from cryptography.utils import int_from_bytes May 26 19:26:54.827215 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:26:54.827215 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: from cryptography.utils import int_from_bytes May 26 19:26:54.828085 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:26:54.828085 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: from cryptography.utils import int_from_bytes May 26 19:26:54.828432 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:26:54.828432 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: from cryptography.utils import int_from_bytes May 26 19:26:57.444010 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 19:26:57.444682 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 19:26:57.444776 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 19:26:57.445130 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 19:26:57.445383 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 19:26:57.445763 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.446018 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 19:26:57.446384 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.446470 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 19:26:57.446549 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.446686 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.447033 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.447343 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.447664 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.447993 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.448305 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.448560 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.448841 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 19:26:57.448940 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.449228 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-17-iscsi {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.449809 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 19:26:57.450014 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 19:26:57.450102 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.450337 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.450425 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.450643 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.450731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.450980 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.451083 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.451371 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.451467 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.451703 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.451960 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.452054 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.452326 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.452443 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.452648 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.452994 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.453205 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.453326 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.454029 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.454146 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.454255 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-17-iscsi {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.454362 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.454477 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.454596 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.454711 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.454817 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.454922 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.455063 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.455149 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.455374 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.455475 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.455628 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.455761 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.455935 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.456023 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.456257 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.456463 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.456573 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.456775 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.456986 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-17-iscsi {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.457135 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.457257 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.457388 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.457566 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.457695 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.457875 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.458010 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.458283 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.458377 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.458592 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.458689 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.458930 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.459057 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.459247 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.459356 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.459552 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.459640 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.459854 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.459951 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-17-iscsi {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.460175 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.460262 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.460490 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.460585 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.460803 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.460892 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.461116 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.461238 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.461414 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.461550 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.461716 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.461856 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.462023 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.462174 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.462335 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.462495 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.462635 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.462801 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.462962 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.463149 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.463248 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.463468 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.463558 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.463785 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.463880 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.464102 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.464198 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.464404 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.464494 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.464657 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.464747 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.464931 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.465034 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.465246 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.465341 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.465562 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.465650 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.465866 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.465963 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.466159 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.466244 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.466460 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.466547 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.466762 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.466933 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.467122 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.467223 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.467392 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.467481 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.467653 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.467748 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.467902 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.467992 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.468217 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.468301 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.468539 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.468628 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.468846 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.468952 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.469153 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.469252 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.469460 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.469557 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.469764 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.469851 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.470070 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.470166 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.470376 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.470463 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.470679 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.470774 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.471006 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.471111 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.471321 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.471407 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.471634 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.471728 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.471948 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.472045 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.472269 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.472365 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.472555 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.472641 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.472856 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.472953 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.473169 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.473257 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.473480 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.473573 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.473780 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.473867 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.474025 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.474128 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.474327 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.474416 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.474627 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.474724 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.474959 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.475050 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.475264 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.475362 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.475565 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.475654 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.475867 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.475955 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.476168 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.476282 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.476494 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.476602 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.476771 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.476872 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.477052 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.477168 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.477352 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.477443 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.477650 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.477736 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.477951 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.478053 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.478251 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.478339 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.478551 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.478639 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.479128 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.479242 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.479423 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.479517 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.479727 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.479815 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.480027 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.480123 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.480327 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.480444 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.480654 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.480752 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.480953 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.481054 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.481252 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.481339 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.481554 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.481647 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.481853 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.481953 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.482157 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.482252 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.482456 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.482542 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.482755 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.482851 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.483088 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.483187 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.483388 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.483475 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.483689 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.483783 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.483990 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.484079 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.484290 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.484390 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.484592 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.484682 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.484893 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.484980 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.485190 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.485275 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.485490 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.485579 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.485788 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.485877 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.486086 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.486175 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.486383 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.486473 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.486683 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.486770 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.487001 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.487150 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.487301 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.487402 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.487596 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.487683 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.487907 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.488000 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.488208 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.488297 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.488509 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.488594 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.488808 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.488905 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.489106 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.489213 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.489407 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.489512 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.489704 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.489803 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.490004 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.490093 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.490303 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.490392 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.490599 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.490769 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.490927 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.491030 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.491249 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.491338 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.491556 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.491653 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.491861 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.491948 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.492162 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.492250 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.492479 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:26:57.492568 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.492805 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.492898 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.493114 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.493202 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.493421 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.493518 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.493733 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.493828 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.494044 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.494140 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.494373 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.494470 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.494684 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.494779 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.495015 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.495116 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.495332 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.495421 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.495636 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.495746 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.495947 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.496579 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.496776 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.496863 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.497086 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.497221 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.497392 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.497494 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.497705 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.497799 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.498032 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.498120 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.498352 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.498448 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.498667 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.498768 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.499003 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.499093 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.499311 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.499467 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.499674 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.499787 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.499929 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.500030 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.500243 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.500345 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.500552 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.500638 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.500865 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.500958 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.501176 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.501273 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.501481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.501570 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.501787 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.501875 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.502090 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.502179 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.502394 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.502522 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.502699 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.502800 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.503032 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.503123 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.503353 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.503452 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.503664 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.503751 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.503973 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.504069 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.504288 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.504382 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.504593 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.504680 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.504900 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.504996 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.505206 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.505291 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.505504 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.505598 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.505805 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.505893 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.506105 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.506194 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.506409 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.506517 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.506709 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.506797 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.507047 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.507137 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.507370 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.507469 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.507669 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.507755 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.507975 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.508061 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.508284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.508379 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.508587 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.508680 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.508892 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.508981 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.509192 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.509279 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.509498 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.509586 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.509803 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.509911 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.510118 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.510207 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.510442 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.510530 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.510750 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.510837 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.511103 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.511206 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.511405 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.511499 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.511763 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.512383 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.512596 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.512687 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.512897 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.512994 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.513201 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.513297 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.513505 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.513591 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.513811 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.513896 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.514116 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.514281 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.514427 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.514515 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.514732 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.514817 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.515060 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.515164 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.515369 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.515455 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.515675 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.515768 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.515980 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.516076 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.516295 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.516383 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.516606 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.516693 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.516916 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.517012 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.517225 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.517320 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.517526 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.517618 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.517830 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.517927 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.518129 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.518229 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.518428 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.518517 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.518728 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.518818 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.519054 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.519146 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.519353 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.519441 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.519651 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.519749 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.519951 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.520052 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.520247 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.520346 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.520603 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.520689 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.520911 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.520999 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.521214 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.521315 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.521519 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.521608 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.521823 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.521909 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.522129 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.522225 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.522434 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.522523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.522737 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.522826 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.523062 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.523169 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.523368 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.523465 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.523671 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.523760 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.523991 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.524081 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.524300 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.524394 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.524603 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.524692 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.524907 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.524996 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.525210 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.525297 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.525515 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.525602 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.525819 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.525908 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.526135 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.526229 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.526440 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.526535 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.526753 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.526843 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.527094 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.527184 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.527452 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.527600 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.527759 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.527854 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.528068 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.528155 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.528367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.528463 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.528678 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.528767 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.528985 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.529071 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.529303 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.529403 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.529612 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.529734 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.529925 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.530067 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.530231 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.530333 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.530541 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.530630 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.530844 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.530979 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.531174 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.531275 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.531478 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.531572 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.531781 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.531867 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.532092 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.532182 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.532398 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.532494 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.532710 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.532798 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.533015 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.533105 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.533332 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.533419 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.533637 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.533724 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.533943 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.534030 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.534245 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.534332 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.534551 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.534636 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.534858 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.534967 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.535197 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.535285 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.535500 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.535588 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.535808 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.535896 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.536112 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.536197 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.536417 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.536512 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.536721 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.536809 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.537025 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.537112 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.537324 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.537422 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.537622 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.537754 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.537924 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.538020 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.538236 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.538333 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.538539 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.538620 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.538842 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.538947 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.539168 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.539302 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.539477 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.539564 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.539783 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.539870 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.540083 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.540208 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.540384 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.540471 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.540687 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.540773 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.540993 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.541088 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.541295 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.541381 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.541602 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.541688 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.541910 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.542000 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.542209 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.542295 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.542510 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.542600 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.542817 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.543442 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.543657 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.543746 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.543958 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.544052 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.544264 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.544353 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.544566 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.544654 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.544880 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.544975 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.545198 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.545285 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.545500 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.545589 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.545805 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.545901 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.546109 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.546196 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.546412 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.546498 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.546721 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.546819 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.547044 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.547132 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.547354 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.547500 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.547648 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.547727 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.547964 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.548059 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.548269 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.548357 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.548575 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.548672 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.548878 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.548967 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.549181 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.549271 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.549486 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.549579 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.549797 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.549884 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.550099 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.550192 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.550404 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.550501 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.550704 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.550792 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.551029 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.551135 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.551335 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.551432 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.551644 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.551731 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.551953 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.552214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.552311 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.552546 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.552640 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.552861 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.552957 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.553166 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.553257 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.553473 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.553606 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.553780 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.553868 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.554084 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.554173 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.554391 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.554480 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.554706 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.554807 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.555062 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.555297 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.555388 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.555626 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.555791 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.555939 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.556036 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.556249 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.556336 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.556553 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.556641 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.556854 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.556952 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.557155 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.557250 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.557461 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.557564 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.557760 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.557895 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.558058 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.558157 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.558357 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.558445 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.559221 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.559354 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.559544 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.559647 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.559843 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.559940 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.560150 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.560239 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.560449 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.560539 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.560750 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.560836 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.561052 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.561141 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.561352 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.561442 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.561649 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.561737 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.561947 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.562045 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.562248 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.562335 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.562562 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.562650 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.562865 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.562982 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.563200 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.563289 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.563504 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.563599 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.563824 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.563925 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.564125 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.564220 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.564424 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.564520 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.564724 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.564822 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.565023 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.565110 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.565325 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.565412 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.565630 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.565728 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.565933 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.566022 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.566233 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.566321 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.566539 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.566636 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.566842 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.566971 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.567172 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.567261 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.567479 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.567571 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.567781 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.567869 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.568087 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.568192 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.568388 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.568516 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.568696 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.568793 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.568997 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.569093 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.569294 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.569382 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.569592 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.569725 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.569896 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.569996 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.570198 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.570287 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.570495 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.570583 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.570794 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.570894 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.571113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.571200 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.571414 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.571500 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.571728 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.571819 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.572034 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.572133 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.572338 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.572478 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.572639 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.572730 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.572941 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.573036 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.573244 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.573330 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.573544 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.573642 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.573849 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.573943 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.574167 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.574257 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.574469 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.574557 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.574772 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.574861 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.575094 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.575184 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.575393 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.575483 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.575696 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.575785 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.576002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.576097 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.576305 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.576399 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.576602 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.576688 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.576905 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.577002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.577206 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.577301 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.577504 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.577593 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.577804 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.577904 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.578106 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.578199 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.578401 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.578494 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.578697 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.578794 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.579017 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.579122 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.579318 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.579420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.579616 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.579706 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.579920 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.580006 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.580220 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.580351 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.580519 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.580645 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.580817 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.580905 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.581113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.581200 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.581411 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.581499 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.581712 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.581799 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.582012 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.582108 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.582315 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.582402 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.582616 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.582703 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.582954 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.583056 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.583264 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.583360 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.583564 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.583657 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.583867 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.583968 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.584166 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.584255 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.584475 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.584562 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.584780 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.584876 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.585089 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.585176 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.585387 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.585477 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.585687 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.585783 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.586002 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.586090 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.586327 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.586422 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.586609 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.586706 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.586944 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.587058 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.587251 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.587341 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.587567 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.587671 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.587974 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.588081 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.588192 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.588264 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.588458 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.588553 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.588758 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.588853 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.589061 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.589147 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.589365 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.589455 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.589669 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.589774 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.589999 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.590099 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.590305 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.590439 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.590609 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.590697 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.590920 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.591024 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.591240 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.591327 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.591541 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.591627 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.591845 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.591946 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.592145 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.592240 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.592448 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.592542 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.592755 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.592857 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.593054 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.593147 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.593359 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.593453 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.593664 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.593752 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.593970 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.594057 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.594273 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.594360 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.594579 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.594738 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.594884 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.595071 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.595214 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.595378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.595544 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.595679 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.595830 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.595983 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.596132 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.596288 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.596437 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.596597 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.596737 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.596907 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.597042 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.597208 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.597344 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.597620 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.597766 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.597930 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.598074 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.598242 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.598393 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.598553 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.598691 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.598853 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.599013 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.599177 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.599313 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.599482 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.599625 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.599802 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.599938 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.600104 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.600239 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.600403 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.600650 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.600741 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.600958 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.601056 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.601265 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.601361 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.601573 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.601661 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.601877 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.601990 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.602178 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.602300 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.602486 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.602616 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.602808 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.603023 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.603125 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.603333 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.603429 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.603639 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.603995 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.604222 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.604310 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.604542 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.604637 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.604862 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.604951 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.605162 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.605274 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.605987 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.606083 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.606293 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.606383 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.606615 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.606789 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.606954 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.607133 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.607251 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.607445 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.607567 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.607769 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.607858 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.608090 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.608179 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.608418 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.608526 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.608721 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.608809 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.609034 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.609129 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.609343 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.609470 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.609666 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.609788 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.609987 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.610114 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.610296 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.610392 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.610607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.610787 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.610927 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.611121 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.611253 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.611426 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.611575 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.611730 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.611892 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.612030 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.612213 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.612330 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.612622 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.612721 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.612934 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.613020 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.613242 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.613344 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.613545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.613640 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.613849 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.613947 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.614154 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.614243 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.614452 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.614541 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.614758 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.614853 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.615085 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.615175 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.615390 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.615487 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.615702 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.615801 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.616004 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.616092 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.616312 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.616399 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.616611 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.616706 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.616915 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.617003 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.617217 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.617304 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.617517 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.617651 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.617814 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.617904 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.618113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.618210 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.618443 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.618552 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.618743 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.618843 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.619082 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.619173 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.619407 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.619498 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.619733 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.619822 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.620041 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.620130 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.620356 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.620446 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.620659 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.620748 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.620962 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.621104 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.621316 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.621406 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.621633 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.621727 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.621933 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.622030 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.622232 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.622320 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.622534 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.622623 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.622834 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.622949 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.623158 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.623250 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.623458 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.623553 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.623760 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.623857 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.624058 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.624160 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.624358 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.624448 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.624655 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.624744 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.624967 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.625056 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.625267 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.625356 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.625596 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.625684 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.625900 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.625988 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.626202 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.626297 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.626504 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.626594 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.626808 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.626957 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.627133 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.627267 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.627433 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.627570 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.627733 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.627899 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.628051 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.628211 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.628358 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.628540 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.628675 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.628852 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.628968 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.629157 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.629269 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.629477 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.629566 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.629787 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.629876 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.630094 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.630196 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.630403 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.630492 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.630713 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.630847 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.631047 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.631139 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.631355 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.631447 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.631664 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.631762 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.631969 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.632057 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.632277 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.632366 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.632584 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.632681 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.632897 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.632986 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.633211 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.633421 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.633510 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.633747 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.633838 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.634057 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.634146 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.634368 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.634458 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.634677 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.634766 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.635008 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.635099 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.635321 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.635483 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.635625 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.635720 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.635931 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.636149 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.636238 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.636473 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.636563 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.637297 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.637388 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.637608 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.637704 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.637919 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.638016 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.638229 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.638325 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.638536 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.638685 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.638849 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.638975 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.639181 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.639270 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.639489 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.639591 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.639797 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.639886 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.640120 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.640208 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.640428 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.640523 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.640740 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.640837 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.641055 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.641144 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.641369 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.641448 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.641678 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.641767 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.641985 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.642074 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.642293 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.642382 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.642601 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.642689 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.642922 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.643025 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.643231 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.643320 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.643538 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.643634 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.643848 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.643945 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.644164 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.644251 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.644479 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.644567 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.644788 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.644887 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.645096 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.645182 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.645402 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.645492 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.645710 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.645799 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.646019 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.646221 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.646331 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.646535 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.646640 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.646865 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.646973 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.647220 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.647310 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.647541 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.647644 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.647855 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.647944 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.648169 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.648258 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.648488 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.648579 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.648790 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.649010 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.649098 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.649324 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.649427 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.649654 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.649743 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.649955 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.650043 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.650273 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.650370 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.650578 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.650668 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.650877 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.651051 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.651213 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.651314 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.651517 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.651650 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.651819 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.652040 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.652138 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.652920 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.653019 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.653242 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.653331 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.653563 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.653661 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.653871 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.653967 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.654175 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.654264 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.654474 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.654571 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.654791 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.654878 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.655118 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.655345 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.655434 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.655694 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.655791 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.656010 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.656107 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.656308 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.656404 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.656607 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.656696 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.656912 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.657001 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.657233 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.657390 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.657510 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.657600 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.657842 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.657930 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.658148 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.658246 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.658463 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.658551 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.658777 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.658866 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.659128 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.659242 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.659430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.659519 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.659740 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.659827 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.660041 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.660132 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.660341 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.660437 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.660641 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.660739 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.660942 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.661030 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.661246 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.661343 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.661545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.661635 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.661847 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.661935 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.662144 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.662232 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.662451 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.662543 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.662747 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.662836 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.663074 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.663163 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.663382 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.663484 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.663686 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.663776 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.663996 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.664083 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.664299 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.664401 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.664630 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.664719 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.664932 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.665020 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.665240 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.665404 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.665543 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.665633 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.665850 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.665936 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.666194 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.666304 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.666508 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.666600 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.666809 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.667056 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.667160 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.667388 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.667478 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.667704 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.667802 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.668056 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.668155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.668371 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.668458 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.668674 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.668760 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.668975 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.669123 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.669278 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.669367 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.669593 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.669839 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.669927 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.670178 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.670268 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.670482 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.670578 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.670787 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.670885 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.671117 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.671253 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.671424 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.671563 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.671728 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.671868 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.672032 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.672171 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.672335 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.672498 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.672637 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.672811 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.672939 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.673124 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.673243 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.673433 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.673530 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.673742 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.673831 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.674050 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.674145 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.674359 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.674459 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.674667 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.674764 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.675000 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.675092 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.675312 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.675417 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.675619 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.675708 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.675925 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.676021 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.676231 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.676359 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.676567 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.676656 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.676885 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.676974 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.677209 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.677300 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.677519 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.677609 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.677821 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.677909 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.678133 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.678221 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.678446 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.678534 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.678763 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.678851 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.679096 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.679188 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.679406 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.679502 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.679715 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.679812 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.680027 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.680116 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.680341 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.680428 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.680652 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.680748 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.680955 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.681043 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.681275 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.681407 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.681609 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.681771 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.681936 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.682027 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.682256 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.682345 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.682559 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.682656 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.682862 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.682969 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.683188 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.683277 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.683509 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.683647 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.683885 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.683982 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.684193 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.684282 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.684494 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.684590 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.684800 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.684890 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.685110 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.685209 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.685411 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.685525 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.685711 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.685833 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.686013 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.686141 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.686313 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.686441 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.686618 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.686744 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.686951 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.687093 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.687240 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.687407 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.687541 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.687712 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.687919 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.688018 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.688224 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.688314 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.688526 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.688623 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.688831 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.688921 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.689131 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.689217 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.689432 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.689520 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.689731 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.689829 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.690033 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.690122 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.690334 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.690424 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.690653 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.690741 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.690978 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.691079 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.691286 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.691375 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.691614 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.691741 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.691900 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.692023 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.692201 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.692297 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.692503 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.692592 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.692805 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.692894 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.693112 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.693209 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.693414 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.693503 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.693745 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.693846 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.694076 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.694244 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.694390 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.694485 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.694695 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.694784 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.695031 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.695125 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.695338 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.695426 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.695643 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.695732 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.695950 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.696040 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.696271 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.696359 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.696588 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.696676 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.696892 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.697028 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.697211 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.697301 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.697518 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.697606 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.697829 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.697919 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.698138 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.698228 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.698445 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.698542 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.698760 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.698850 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.699090 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.699698 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.699954 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.700064 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.700262 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.700353 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.700566 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.700653 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.700871 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.700967 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.701183 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.701279 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.701495 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.701638 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.701809 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.701898 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.702122 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.702211 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.702423 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.702512 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.702744 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.702837 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.703075 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.703201 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.703390 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.703482 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.703699 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.703790 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.704010 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.704100 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.704325 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.704423 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.704640 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.704761 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.704951 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.705030 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.705252 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.705343 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.705491 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 19:26:57.705645 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.705972 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.706299 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.706646 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.706985 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.707333 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.707661 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.707976 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.708289 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.708592 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:26:57.708834 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 19:26:57.764462 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO dbcounter [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Registered counter for database nova_api May 26 19:26:57.768008 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO dbcounter [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Registered counter for database nova_api May 26 19:26:57.786428 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:26:57.788234 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-707a8931-a773-4948-840f-f44976b7a638 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:26:57.793290 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:26:57.794950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:26:57.851365 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.context [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1f15ba6-4bbf-4710-a76f-47f056c03285(cell1) {{(pid=103939) load_cells /opt/stack/nova/nova/context.py:464}} May 26 19:26:57.852793 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.context [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1f15ba6-4bbf-4710-a76f-47f056c03285(cell1) {{(pid=103940) load_cells /opt/stack/nova/nova/context.py:464}} May 26 19:26:57.855803 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:26:57.857518 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:26:57.857632 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:26:57.858225 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:26:57.858860 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:26:57.859714 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:26:57.860205 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:26:57.861692 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:26:57.862201 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO dbcounter [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Registered counter for database nova_cell0 May 26 19:26:57.863725 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO dbcounter [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Registered counter for database nova_cell0 May 26 19:26:57.866279 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO dbcounter [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Registered counter for database nova_cell1 May 26 19:26:57.867788 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO dbcounter [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Registered counter for database nova_cell1 May 26 19:26:57.873570 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:26:57.875437 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:26:57.879892 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-707a8931-a773-4948-840f-f44976b7a638 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:26:57.880692 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-707a8931-a773-4948-840f-f44976b7a638 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:26:57.881562 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:26:57.883656 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:26:57.887964 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:26:57.889967 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:26:58.032221 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO dbcounter [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Registered counter for database nova_cell0 May 26 19:26:58.038382 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO dbcounter [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Registered counter for database nova_cell0 May 26 19:26:58.041128 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:26:58.045783 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:26:58.047049 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-707a8931-a773-4948-840f-f44976b7a638 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:26:58.051463 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:26:58.489271 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 19:26:58.497213 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 19:26:58.518848 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-707a8931-a773-4948-840f-f44976b7a638 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 19:26:58.526578 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 19:26:58.840458 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 19:26:58.846425 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 19:26:58.851746 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c7a7a69c0 pid: 103939 (default app) May 26 19:26:58.854053 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:26:58.855265 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001978 May 26 19:26:58.856234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 788 bytes} [Thu May 26 19:26:58 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:26:58.869686 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-707a8931-a773-4948-840f-f44976b7a638 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 19:26:58.875676 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-707a8931-a773-4948-840f-f44976b7a638 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 19:26:58.880869 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c7a7a69c0 pid: 103940 (default app) May 26 19:28:23.112068 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:23.113890 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 26 19:28:23.113890 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:23.126596 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=3 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:23.128289 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_cell0:SELECT=3 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:23.129347 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_cell1:SELECT=3 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:23.130203 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:23.577836 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-d41eb73b-e0e3-436e-9d9c-a5080725f88f admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:23.607908 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-d41eb73b-e0e3-436e-9d9c-a5080725f88f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.486638 May 26 19:28:23.608653 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1291 bytes} [Thu May 26 19:28:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:28:25.903025 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:25.904585 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ba01b4b8-cc24-46cc-a037-425a691083da None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 May 26 19:28:25.910063 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 3/4] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:25.972611 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-c9ac224b-eb6c-4794-b59a-3d87668e49eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 256, "name": "cirros256"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:25.999198 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:28:25.999198 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: warnings.warn(msg) May 26 19:28:26.139110 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-c9ac224b-eb6c-4794-b59a-3d87668e49eb admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.227453 May 26 19:28:26.146617 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 2/5] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 19:28:26.153769 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:26.155016 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell0:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:26.155774 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell1:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:26.156855 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:26.357225 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-b348dbbf-158a-41f3-a2e8-14154699494d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:26.359779 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:28:26.359779 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: warnings.warn(msg) May 26 19:28:26.495048 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-b348dbbf-158a-41f3-a2e8-14154699494d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.347034 May 26 19:28:26.509423 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 4/6] 10.222.0.72 () {64 vars in 1335 bytes} [Thu May 26 19:28:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:28:28.776367 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-c9ac224b-eb6c-4794-b59a-3d87668e49eb admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:28.777456 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-c9ac224b-eb6c-4794-b59a-3d87668e49eb admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 May 26 19:28:28.777933 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 3/7] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:28.929250 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f4e1b398-144f-4b10-95fd-4059a4f8a4aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:28.948189 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:28:28.948189 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: warnings.warn(msg) May 26 19:28:29.098022 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-f4e1b398-144f-4b10-95fd-4059a4f8a4aa admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.310873 May 26 19:28:29.098022 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 5/8] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:28:29.113534 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b32d3360-5f86-49bd-b0ba-dfd6b7fa2ee3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:29.115033 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:28:29.115033 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: warnings.warn(msg) May 26 19:28:29.353107 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-b32d3360-5f86-49bd-b0ba-dfd6b7fa2ee3 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.241730 May 26 19:28:29.354417 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 4/9] 10.222.0.72 () {64 vars in 1335 bytes} [Thu May 26 19:28:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:28:31.655647 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f4e1b398-144f-4b10-95fd-4059a4f8a4aa admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:31.657275 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-f4e1b398-144f-4b10-95fd-4059a4f8a4aa admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002109 May 26 19:28:31.658193 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:31.732661 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b50deee8-d2a6-4bfe-a85d-af4bf0bd6f70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 1024, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:32.141830 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-b50deee8-d2a6-4bfe-a85d-af4bf0bd6f70 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476858 May 26 19:28:32.142459 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 5/11] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:28:32.156052 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e134863c-02c6-4eb0-ae95-aa99e5608c45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:32.287043 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-e134863c-02c6-4eb0-ae95-aa99e5608c45 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135170 May 26 19:28:32.295620 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 7/12] 10.222.0.72 () {64 vars in 1335 bytes} [Thu May 26 19:28:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:28:34.548837 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b50deee8-d2a6-4bfe-a85d-af4bf0bd6f70 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:34.549857 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-b50deee8-d2a6-4bfe-a85d-af4bf0bd6f70 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 26 19:28:34.550256 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 6/13] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:34.617963 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-885cacf6-b921-41e9-81bb-3fda7c73e8dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "ds2G", "id": "d3"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:34.706227 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-885cacf6-b921-41e9-81bb-3fda7c73e8dc admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149142 May 26 19:28:34.706811 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 8/14] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:28:34.719341 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-3707f57a-55ac-4b91-a2f7-cb163257ef9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:34.921256 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-3707f57a-55ac-4b91-a2f7-cb163257ef9b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.205594 May 26 19:28:34.921848 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 7/15] 10.222.0.72 () {64 vars in 1335 bytes} [Thu May 26 19:28:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:28:37.227293 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-885cacf6-b921-41e9-81bb-3fda7c73e8dc admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:37.228340 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-885cacf6-b921-41e9-81bb-3fda7c73e8dc admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 May 26 19:28:37.229047 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 9/16] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:37.292987 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-da4277bf-3809-4fdc-80b5-b796e053f4c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "id": "d4", "disk": 20, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:37.449046 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-da4277bf-3809-4fdc-80b5-b796e053f4c4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.212935 May 26 19:28:37.449679 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 8/17] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:28:37.461653 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-86f61538-bbba-4231-9a5b-a3c4ed1b098b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:37.620488 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-86f61538-bbba-4231-9a5b-a3c4ed1b098b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.161909 May 26 19:28:37.621333 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 10/18] 10.222.0.72 () {64 vars in 1335 bytes} [Thu May 26 19:28:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:28:39.893609 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-da4277bf-3809-4fdc-80b5-b796e053f4c4 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:39.894617 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-da4277bf-3809-4fdc-80b5-b796e053f4c4 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 26 19:28:39.895230 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 9/19] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:39.960803 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7d3bd0ec-3eab-41c5-9e39-9a8c4760fc7f admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:39.985632 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7d3bd0ec-3eab-41c5-9e39-9a8c4760fc7f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083609 May 26 19:28:39.986433 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 11/20] 10.222.0.72 () {60 vars in 1291 bytes} [Thu May 26 19:28:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:28:42.314978 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-da4277bf-3809-4fdc-80b5-b796e053f4c4 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:42.316025 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-da4277bf-3809-4fdc-80b5-b796e053f4c4 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 26 19:28:42.316455 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 10/21] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:42.382381 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-b8961328-f678-4e12-b0ef-e2fa0dc0dd62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "id": "1", "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:42.557737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-b8961328-f678-4e12-b0ef-e2fa0dc0dd62 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.234346 May 26 19:28:42.558292 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 12/22] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 19:28:42.570552 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-fa28b1fc-9ef5-4dc5-856d-d54cd4944b3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:42.759643 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-fa28b1fc-9ef5-4dc5-856d-d54cd4944b3f admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.192529 May 26 19:28:42.760615 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 11/23] 10.222.0.72 () {64 vars in 1332 bytes} [Thu May 26 19:28:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:28:45.065692 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-b8961328-f678-4e12-b0ef-e2fa0dc0dd62 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:45.066797 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-b8961328-f678-4e12-b0ef-e2fa0dc0dd62 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 May 26 19:28:45.067333 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:45.154486 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-fe35a85d-e2ea-4b9b-8a3e-e4f29fe47d4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:45.288212 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-fe35a85d-e2ea-4b9b-8a3e-e4f29fe47d4d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.213567 May 26 19:28:45.305609 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 12/25] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:28:45.305877 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-95e8fd25-1284-4713-9bd9-5b83c4211da8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:45.504479 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-95e8fd25-1284-4713-9bd9-5b83c4211da8 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.207504 May 26 19:28:45.505075 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 14/26] 10.222.0.72 () {64 vars in 1332 bytes} [Thu May 26 19:28:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:28:47.782301 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-fe35a85d-e2ea-4b9b-8a3e-e4f29fe47d4d admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:47.783354 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-fe35a85d-e2ea-4b9b-8a3e-e4f29fe47d4d admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 26 19:28:47.783763 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 13/27] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:47.845089 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-46433890-5d46-4897-8d2d-6a9ecde06eb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "disk": 40, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:47.997149 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-46433890-5d46-4897-8d2d-6a9ecde06eb9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.207014 May 26 19:28:47.997796 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 15/28] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:28:48.010274 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-cc53a001-74e6-4e00-9a98-b8dd6d9ee94a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:48.166803 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-cc53a001-74e6-4e00-9a98-b8dd6d9ee94a admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160872 May 26 19:28:48.167465 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 14/29] 10.222.0.72 () {64 vars in 1332 bytes} [Thu May 26 19:28:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:28:50.432803 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-46433890-5d46-4897-8d2d-6a9ecde06eb9 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:50.433842 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-46433890-5d46-4897-8d2d-6a9ecde06eb9 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001720 May 26 19:28:50.434235 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 16/30] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:50.494860 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-4ae4742e-c02a-4986-9f0a-e379be129e4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:50.660582 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-4ae4742e-c02a-4986-9f0a-e379be129e4f admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.219460 May 26 19:28:50.661073 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 15/31] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:28:50.673885 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-aef6a77e-c7a2-443e-974f-dadd3935f76e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:50.813237 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-aef6a77e-c7a2-443e-974f-dadd3935f76e admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143127 May 26 19:28:50.813816 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 17/32] 10.222.0.72 () {64 vars in 1332 bytes} [Thu May 26 19:28:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:28:53.145342 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-4ae4742e-c02a-4986-9f0a-e379be129e4f admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:28:53.146477 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-4ae4742e-c02a-4986-9f0a-e379be129e4f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 May 26 19:28:53.147198 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:28:53.234164 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7c0e2967-7537-4a57-a91c-c000ad6e5aaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "name": "m1.xlarge"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:53.352762 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7c0e2967-7537-4a57-a91c-c000ad6e5aaa admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.198721 May 26 19:28:53.354348 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 18/34] 10.222.0.72 () {64 vars in 1282 bytes} [Thu May 26 19:28:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:28:53.366230 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-6fa9b0fb-bd04-4ef6-980c-6c916f28ed0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:28:53.372333 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:53.521581 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-6fa9b0fb-bd04-4ef6-980c-6c916f28ed0b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159144 May 26 19:28:53.522158 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 17/35] 10.222.0.72 () {64 vars in 1332 bytes} [Thu May 26 19:28:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:29:18.029699 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7c0e2967-7537-4a57-a91c-c000ad6e5aaa admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:18.030754 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7c0e2967-7537-4a57-a91c-c000ad6e5aaa admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 26 19:29:18.031181 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 19/36] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:29:18.090358 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-8be2dd48-7cf7-474f-b5c8-f60ff407253a admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:18.108639 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-8be2dd48-7cf7-474f-b5c8-f60ff407253a admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071312 May 26 19:29:18.109166 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 18/37] 10.222.0.72 () {60 vars in 1291 bytes} [Thu May 26 19:29:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:29:19.140777 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7c0e2967-7537-4a57-a91c-c000ad6e5aaa admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:19.141774 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7c0e2967-7537-4a57-a91c-c000ad6e5aaa admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 26 19:29:19.142167 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 20/38] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:29:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:29:19.393500 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-32aa99c0-0da5-4b7f-a487-60b75251738b admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:19.399152 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.wsgi [None req-32aa99c0-0da5-4b7f-a487-60b75251738b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-32aa99c0-0da5-4b7f-a487-60b75251738b admin admin] Request method failure captured: May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Accept: application/json May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Accept-Encoding: gzip, deflate May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Connection: keep-alive May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Content-Length: 0 May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Host: 10.222.0.72 May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Openstack-Api-Version: compute 2.90 May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Openstack-System-Scope: None May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: User-Agent: python-novaclient May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Auth-Token: gAAAAABij9UP5WV3Oq-TL-itULsHkfyzJ-5TFpxPPY_jaD0fLHOV8PXczoDCNKqmlivoRqJytLPUobYD8uBbzIK7n-Jqm2XjHl91hGRO9c02zznJOyLPlGCh9JvGSsxrRWaeq4fUXZUO0IDiJ7ItW-EHI3FvkXVd8PCeuGVIhC-g0QmqMYSW0hM May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Domain-Id: None May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Domain-Name: None May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Identity-Status: Confirmed May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Is-Admin-Project: True May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Openstack-Nova-Api-Version: 2.90 May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Domain-Id: default May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Domain-Name: Default May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Name: admin May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Role: member,reader,admin May 26 19:29:19.403708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Roles: member,reader,admin May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_682ee24b662c4ff6b4e5f85944069ca4", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Tenant: admin May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Tenant-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Tenant-Name: admin May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User: admin May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Domain-Id: default May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Domain-Name: Default May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Id: 1b078b07f0674c59bddde235c1d0d60f May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Name: admin May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: method: > May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: exception: Flavor 42 could not be found. May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: action_args: {'id': '42'} May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:29:19.406002 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:19.406887 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:19.408155 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-32aa99c0-0da5-4b7f-a487-60b75251738b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:29:19.409213 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-32aa99c0-0da5-4b7f-a487-60b75251738b admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067395 May 26 19:29:19.409213 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1190 bytes} [Thu May 26 19:29:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 19:29:19.415653 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-6529f341-05db-450b-a9e0-198eb9f2d70b admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:19.418604 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:29:19.438142 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-6529f341-05db-450b-a9e0-198eb9f2d70b admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026445 May 26 19:29:19.438715 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 21/40] 10.222.0.72 () {60 vars in 1210 bytes} [Thu May 26 19:29:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:29:19.448775 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-58e0b916-7ac9-4521-9add-98a3f1d4939a admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:19.470731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-58e0b916-7ac9-4521-9add-98a3f1d4939a admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025654 May 26 19:29:19.471319 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 20/41] 10.222.0.72 () {60 vars in 1210 bytes} [Thu May 26 19:29:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:29:19.481760 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e1837e66-203d-48fd-b580-b1c2ac5ce35e admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:19.488142 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.wsgi [None req-e1837e66-203d-48fd-b580-b1c2ac5ce35e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e1837e66-203d-48fd-b580-b1c2ac5ce35e admin admin] Request method failure captured: May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Accept: application/json May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Accept-Encoding: gzip, deflate May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Connection: keep-alive May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Content-Length: 0 May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Host: 10.222.0.72 May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Openstack-Api-Version: compute 2.90 May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Openstack-System-Scope: None May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: User-Agent: python-novaclient May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Auth-Token: gAAAAABij9UP5WV3Oq-TL-itULsHkfyzJ-5TFpxPPY_jaD0fLHOV8PXczoDCNKqmlivoRqJytLPUobYD8uBbzIK7n-Jqm2XjHl91hGRO9c02zznJOyLPlGCh9JvGSsxrRWaeq4fUXZUO0IDiJ7ItW-EHI3FvkXVd8PCeuGVIhC-g0QmqMYSW0hM May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Domain-Id: None May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Domain-Name: None May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Identity-Status: Confirmed May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Is-Admin-Project: True May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Openstack-Nova-Api-Version: 2.90 May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Domain-Id: default May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Domain-Name: Default May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Name: admin May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Role: member,reader,admin May 26 19:29:19.492059 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Roles: member,reader,admin May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_682ee24b662c4ff6b4e5f85944069ca4", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Tenant: admin May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Tenant-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Tenant-Name: admin May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User: admin May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Domain-Id: default May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Domain-Name: Default May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Id: 1b078b07f0674c59bddde235c1d0d60f May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Name: admin May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: method: > May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: exception: Flavor 42 could not be found. May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: action_args: {'id': '42'} May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:29:19.493626 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:19.494737 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:19.496523 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e1837e66-203d-48fd-b580-b1c2ac5ce35e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:29:19.497735 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-e1837e66-203d-48fd-b580-b1c2ac5ce35e admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015590 May 26 19:29:19.497735 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 22/42] 10.222.0.72 () {60 vars in 1190 bytes} [Thu May 26 19:29:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 19:29:20.356040 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-58e0b916-7ac9-4521-9add-98a3f1d4939a admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:20.357093 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-58e0b916-7ac9-4521-9add-98a3f1d4939a admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 26 19:29:20.357493 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:29:20.545368 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-9d8675f6-dddb-4521-a98b-0c4a59ef18e2 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:20.551821 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.wsgi [None req-9d8675f6-dddb-4521-a98b-0c4a59ef18e2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-9d8675f6-dddb-4521-a98b-0c4a59ef18e2 admin admin] Request method failure captured: May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Accept: application/json May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Accept-Encoding: gzip, deflate May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Connection: keep-alive May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Content-Length: 0 May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Host: 10.222.0.72 May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Openstack-Api-Version: compute 2.90 May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Openstack-System-Scope: None May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: User-Agent: python-novaclient May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Auth-Token: gAAAAABij9UQUVnJ90Fnwcte8JR4NCfB4M4GB0FJY8aHPG5z8NB1VrX3O9JxmRucMaumptPUr__0qMBoY8jWmf9l7Met_CU612q9JEGPkx51R5xEN01JZcXD6uBfz4_ccAyj6jQlylDZ1tOfOpuoCs39hCsqjugEV8aUKIIIat2v_SBgeugWqoU May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Domain-Id: None May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Domain-Name: None May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Identity-Status: Confirmed May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Is-Admin-Project: True May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Openstack-Nova-Api-Version: 2.90 May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Domain-Id: default May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Domain-Name: Default May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Name: admin May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Role: member,reader,admin May 26 19:29:20.552378 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Roles: member,reader,admin May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_682ee24b662c4ff6b4e5f85944069ca4", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Tenant: admin May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Tenant-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Tenant-Name: admin May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User: admin May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Domain-Id: default May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Domain-Name: Default May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Id: 1b078b07f0674c59bddde235c1d0d60f May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Name: admin May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: method: > May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: exception: Flavor 84 could not be found. May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: action_args: {'id': '84'} May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:29:20.554367 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:20.555214 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:20.556284 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-9d8675f6-dddb-4521-a98b-0c4a59ef18e2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:29:20.557321 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-9d8675f6-dddb-4521-a98b-0c4a59ef18e2 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060632 May 26 19:29:20.557321 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1190 bytes} [Thu May 26 19:29:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 19:29:20.564169 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-15b0f4d3-e145-493a-92de-dafe5d771390 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:20.580252 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-15b0f4d3-e145-493a-92de-dafe5d771390 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019746 May 26 19:29:20.580788 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1210 bytes} [Thu May 26 19:29:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:29:20.590643 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-0d1b69f6-17e5-4be7-9eab-96c8eafd82a0 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:20.605434 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-0d1b69f6-17e5-4be7-9eab-96c8eafd82a0 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018723 May 26 19:29:20.605952 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1210 bytes} [Thu May 26 19:29:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:29:20.615258 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-32ab5183-0939-4e0c-919f-ce3c9be70070 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:20.622679 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.wsgi [None req-32ab5183-0939-4e0c-919f-ce3c9be70070 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-32ab5183-0939-4e0c-919f-ce3c9be70070 admin admin] Request method failure captured: May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Accept: application/json May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Accept-Encoding: gzip, deflate May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Connection: keep-alive May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Content-Length: 0 May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Host: 10.222.0.72 May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Openstack-Api-Version: compute 2.90 May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Openstack-System-Scope: None May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: User-Agent: python-novaclient May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Auth-Token: gAAAAABij9UQUVnJ90Fnwcte8JR4NCfB4M4GB0FJY8aHPG5z8NB1VrX3O9JxmRucMaumptPUr__0qMBoY8jWmf9l7Met_CU612q9JEGPkx51R5xEN01JZcXD6uBfz4_ccAyj6jQlylDZ1tOfOpuoCs39hCsqjugEV8aUKIIIat2v_SBgeugWqoU May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Domain-Id: None May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Domain-Name: None May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Identity-Status: Confirmed May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Is-Admin-Project: True May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Openstack-Nova-Api-Version: 2.90 May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Domain-Id: default May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Domain-Name: Default May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Name: admin May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Role: member,reader,admin May 26 19:29:20.625420 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Roles: member,reader,admin May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_682ee24b662c4ff6b4e5f85944069ca4", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Tenant: admin May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Tenant-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Tenant-Name: admin May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User: admin May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Domain-Id: default May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Domain-Name: Default May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Id: 1b078b07f0674c59bddde235c1d0d60f May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Name: admin May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: method: > May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: exception: Flavor 84 could not be found. May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: action_args: {'id': '84'} May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:29:20.626731 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:20.627607 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:20.628741 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-32ab5183-0939-4e0c-919f-ce3c9be70070 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:29:20.629789 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-32ab5183-0939-4e0c-919f-ce3c9be70070 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015132 May 26 19:29:20.629789 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1190 bytes} [Thu May 26 19:29:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 19:29:21.494537 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-0d1b69f6-17e5-4be7-9eab-96c8eafd82a0 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:21.495575 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-0d1b69f6-17e5-4be7-9eab-96c8eafd82a0 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 26 19:29:21.495966 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 25/48] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:29:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:29:21.691908 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-26b8a6d4-4f4a-4e95-9789-1c1dd522b16c admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:21.698389 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.wsgi [None req-26b8a6d4-4f4a-4e95-9789-1c1dd522b16c admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-26b8a6d4-4f4a-4e95-9789-1c1dd522b16c admin admin] Request method failure captured: May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Accept: application/json May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Accept-Encoding: gzip, deflate May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Connection: keep-alive May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Content-Length: 0 May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Host: 10.222.0.72 May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Openstack-Api-Version: compute 2.90 May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Openstack-System-Scope: None May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: User-Agent: python-novaclient May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Auth-Token: gAAAAABij9URkbrXAhYsqp3krMhCMVDFtfEh4mWxA6eaW4wYMKdD336MkABEvI5HvNIrQ_H6gtksf65tChnF1WqbB279a_F9IN4Q4wccd7akjn-b9-z0oZgCPLwj8prSrUFvKbDKHqwBzMogaHW4jWPujthsEinAIKvpswmhkL-uawXDSOM0O9c May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Domain-Id: None May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Domain-Name: None May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Identity-Status: Confirmed May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Is-Admin-Project: True May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Openstack-Nova-Api-Version: 2.90 May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Domain-Id: default May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Domain-Name: Default May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Project-Name: admin May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Role: member,reader,admin May 26 19:29:21.699989 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Roles: member,reader,admin May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_682ee24b662c4ff6b4e5f85944069ca4", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Tenant: admin May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Tenant-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-Tenant-Name: admin May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User: admin May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Domain-Id: default May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Domain-Name: Default May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Id: 1b078b07f0674c59bddde235c1d0d60f May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: X-User-Name: admin May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: method: > May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: exception: Flavor 451 could not be found. May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: action_args: {'id': '451'} May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:29:21.701430 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:21.702290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi May 26 19:29:21.703950 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-26b8a6d4-4f4a-4e95-9789-1c1dd522b16c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:29:21.705273 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-26b8a6d4-4f4a-4e95-9789-1c1dd522b16c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061995 May 26 19:29:21.705273 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 24/49] 10.222.0.72 () {60 vars in 1193 bytes} [Thu May 26 19:29:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 19:29:21.712364 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-8d4012ac-27ed-4d79-b2dd-16fb3a6e7349 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:21.725906 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-8d4012ac-27ed-4d79-b2dd-16fb3a6e7349 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017696 May 26 19:29:21.726443 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 26/50] 10.222.0.72 () {60 vars in 1210 bytes} [Thu May 26 19:29:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:29:21.736290 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:21.749748 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016988 May 26 19:29:21.750270 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 25/51] 10.222.0.72 () {60 vars in 1210 bytes} [Thu May 26 19:29:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:29:21.760466 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-60d33845-413c-4d3f-9e6d-b5ab17802856 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:21.766006 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.wsgi [None req-60d33845-413c-4d3f-9e6d-b5ab17802856 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-60d33845-413c-4d3f-9e6d-b5ab17802856 admin admin] Request method failure captured: May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Accept: application/json May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Accept-Encoding: gzip, deflate May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Connection: keep-alive May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Content-Length: 0 May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Host: 10.222.0.72 May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Openstack-Api-Version: compute 2.90 May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Openstack-System-Scope: None May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: User-Agent: python-novaclient May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Auth-Token: gAAAAABij9URkbrXAhYsqp3krMhCMVDFtfEh4mWxA6eaW4wYMKdD336MkABEvI5HvNIrQ_H6gtksf65tChnF1WqbB279a_F9IN4Q4wccd7akjn-b9-z0oZgCPLwj8prSrUFvKbDKHqwBzMogaHW4jWPujthsEinAIKvpswmhkL-uawXDSOM0O9c May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Domain-Id: None May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Domain-Name: None May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Identity-Status: Confirmed May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Is-Admin-Project: True May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Openstack-Nova-Api-Version: 2.90 May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Domain-Id: default May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Domain-Name: Default May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Project-Name: admin May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Role: member,reader,admin May 26 19:29:21.767545 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Roles: member,reader,admin May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_682ee24b662c4ff6b4e5f85944069ca4", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/682ee24b662c4ff6b4e5f85944069ca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Tenant: admin May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Tenant-Id: 682ee24b662c4ff6b4e5f85944069ca4 May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-Tenant-Name: admin May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User: admin May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Domain-Id: default May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Domain-Name: Default May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Id: 1b078b07f0674c59bddde235c1d0d60f May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: X-User-Name: admin May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: method: > May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: exception: Flavor 451 could not be found. May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: action_args: {'id': '451'} May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:29:21.769234 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:21.770113 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi May 26 19:29:21.771481 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-60d33845-413c-4d3f-9e6d-b5ab17802856 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:29:21.773273 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-60d33845-413c-4d3f-9e6d-b5ab17802856 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012659 May 26 19:29:21.773273 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 27/52] 10.222.0.72 () {60 vars in 1193 bytes} [Thu May 26 19:29:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 19:29:22.642792 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:22.644708 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002609 May 26 19:29:22.645422 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:29:22.842710 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e315bf21-2464-4b58-b7d8-7f66f27466e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:29:22.968314 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-e315bf21-2464-4b58-b7d8-7f66f27466e2 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.179928 May 26 19:29:22.968943 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 28/54] 10.222.0.72 () {64 vars in 1235 bytes} [Thu May 26 19:29:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:29:23.859573 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:23.860657 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 May 26 19:29:23.861045 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:29:24.051905 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-385ef928-8150-4b9b-a9f4-cd62b8718b06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:29:24.145114 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-385ef928-8150-4b9b-a9f4-cd62b8718b06 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.145398 May 26 19:29:24.145661 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 29/56] 10.222.0.72 () {64 vars in 1235 bytes} [Thu May 26 19:29:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:29:25.020647 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:25.021778 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 26 19:29:25.022225 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:29:25.213732 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-88120714-d2e7-4527-9c52-b0a5549ca115 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:29:25.379269 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-88120714-d2e7-4527-9c52-b0a5549ca115 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.217651 May 26 19:29:25.379806 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 30/58] 10.222.0.72 () {64 vars in 1235 bytes} [Thu May 26 19:29:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:29:26.252464 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:26.253484 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 26 19:29:26.253882 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 29/59] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:29:26.441161 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-3ae267dc-2ab6-4557-b552-8aafceb150bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:29:26.585371 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-3ae267dc-2ab6-4557-b552-8aafceb150bb admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.195829 May 26 19:29:26.585936 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 31/60] 10.222.0.72 () {64 vars in 1235 bytes} [Thu May 26 19:29:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:29:27.474218 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:27.475874 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 26 19:29:27.476265 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 30/61] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:29:27.668660 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-2f826e41-fb7c-4f34-9039-0e3db904b43a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:29:27.687618 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-2f826e41-fb7c-4f34-9039-0e3db904b43a admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072131 May 26 19:29:27.688138 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 32/62] 10.222.0.72 () {60 vars in 1202 bytes} [Thu May 26 19:29:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:30:31.661015 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:30:31.662011 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-27c99dc6-64bb-402b-86ea-926fa6f8d183 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 26 19:30:31.662404 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 31/63] 10.222.0.72 () {54 vars in 930 bytes} [Thu May 26 19:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:30:31.669969 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:30:31.724160 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-b819a97c-9291-4af9-8d81-fb8da72575bc admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:30:31.747556 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-b819a97c-9291-4af9-8d81-fb8da72575bc admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079092 May 26 19:30:31.748104 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 33/64] 10.222.0.72 () {60 vars in 1291 bytes} [Thu May 26 19:30:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:30:31.768804 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:30:31.773262 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-61da2f01-685e-49d6-b48e-49ccb348e47f admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:30:31.780857 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-61da2f01-685e-49d6-b48e-49ccb348e47f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013541 May 26 19:30:31.781386 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 32/65] 10.222.0.72 () {60 vars in 1282 bytes} [Thu May 26 19:30:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:30:31.794774 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-c271a695-bc7b-4eb2-8328-46f699120105 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:30:31.802895 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-c271a695-bc7b-4eb2-8328-46f699120105 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012186 May 26 19:30:31.803454 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 34/66] 10.222.0.72 () {60 vars in 1285 bytes} [Thu May 26 19:30:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:30:31.815124 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:30:31.823365 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011864 May 26 19:30:31.823900 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 33/67] 10.222.0.72 () {60 vars in 1285 bytes} [Thu May 26 19:30:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:30:31.837414 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ca87e133-d56b-4502-8135-301e6e43c5aa admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:30:31.845027 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ca87e133-d56b-4502-8135-301e6e43c5aa admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011249 May 26 19:30:31.845542 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 35/68] 10.222.0.72 () {60 vars in 1282 bytes} [Thu May 26 19:30:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:34:49.948200 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:34:49.950684 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003126 May 26 19:34:49.951115 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 34/69] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:34:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:34:50.108357 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=6 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:34:50.221040 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-a52eadcc-d8cd-4966-be31-9f537fa9939e admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:34:50.222197 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:34:50.222197 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: warnings.warn(msg) May 26 19:34:50.223415 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-a52eadcc-d8cd-4966-be31-9f537fa9939e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:34:50.223852 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-a52eadcc-d8cd-4966-be31-9f537fa9939e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:34:50.224624 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-a52eadcc-d8cd-4966-be31-9f537fa9939e admin admin] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:34:50.225042 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-a52eadcc-d8cd-4966-be31-9f537fa9939e admin admin] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:34:50.258755 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-a52eadcc-d8cd-4966-be31-9f537fa9939e admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.151886 May 26 19:34:50.259335 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 36/70] 10.222.0.72 () {60 vars in 1193 bytes} [Thu May 26 19:34:50 2022] GET /compute/v2.1/os-services => generated 794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:34:51.157068 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:34:51.158274 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002437 May 26 19:34:51.158527 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 35/71] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:34:51.349379 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e96c2671-43b3-46be-a434-3927c2f71e0d admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:34:51.350575 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:34:51.350575 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: warnings.warn(msg) May 26 19:34:51.351786 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-e96c2671-43b3-46be-a434-3927c2f71e0d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:34:51.352226 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-e96c2671-43b3-46be-a434-3927c2f71e0d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:34:51.353031 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-e96c2671-43b3-46be-a434-3927c2f71e0d admin admin] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:34:51.353460 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-e96c2671-43b3-46be-a434-3927c2f71e0d admin admin] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:34:51.373551 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-e96c2671-43b3-46be-a434-3927c2f71e0d admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075537 May 26 19:34:51.374117 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 37/72] 10.222.0.72 () {60 vars in 1193 bytes} [Thu May 26 19:34:51 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:35:02.679836 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:35:02.680874 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 26 19:35:02.681283 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 36/73] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:35:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:35:02.824032 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell0:SELECT=4 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:35:02.824756 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell1:SELECT=4 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:35:02.825380 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=8 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:35:02.874067 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-03fecd2e-fed7-42a1-8add-cb8b877d4ac8 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:35:02.875270 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:35:02.875270 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: warnings.warn(msg) May 26 19:35:02.876451 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-03fecd2e-fed7-42a1-8add-cb8b877d4ac8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:35:02.876891 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-03fecd2e-fed7-42a1-8add-cb8b877d4ac8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:35:02.877667 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-03fecd2e-fed7-42a1-8add-cb8b877d4ac8 admin admin] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:35:02.878093 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-03fecd2e-fed7-42a1-8add-cb8b877d4ac8 admin admin] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:35:02.911005 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-03fecd2e-fed7-42a1-8add-cb8b877d4ac8 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084918 May 26 19:35:02.911005 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 38/74] 10.222.0.72 () {60 vars in 1193 bytes} [Thu May 26 19:35:02 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:35:03.805752 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:35:03.806753 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-392077d2-f337-46e1-a3f6-4cea6dcb0aef admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 26 19:35:03.807185 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 37/75] 10.222.0.72 () {56 vars in 1074 bytes} [Thu May 26 19:35:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:35:03.998301 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-e503620e-c01b-4f73-b19d-459f99099f2a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:35:03.999482 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:35:03.999482 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: warnings.warn(msg) May 26 19:35:04.000701 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-e503620e-c01b-4f73-b19d-459f99099f2a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:35:04.001142 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-e503620e-c01b-4f73-b19d-459f99099f2a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:35:04.001917 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-e503620e-c01b-4f73-b19d-459f99099f2a admin admin] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:35:04.002341 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-e503620e-c01b-4f73-b19d-459f99099f2a admin admin] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:35:04.023486 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-e503620e-c01b-4f73-b19d-459f99099f2a admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077134 May 26 19:35:04.024549 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 39/76] 10.222.0.72 () {60 vars in 1193 bytes} [Thu May 26 19:35:03 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:36:04.326816 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: Thu May 26 19:36:04 2022 - graceful shutdown triggered... May 26 19:36:04.326988 dv-cinder-825492-17-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 19:36:04.327897 dv-cinder-825492-17-iscsi devstack@n-api.service[103939]: Gracefully killing worker 1 (pid: 103939)... May 26 19:36:04.328339 dv-cinder-825492-17-iscsi devstack@n-api.service[103940]: Gracefully killing worker 2 (pid: 103940)... May 26 19:36:05.328989 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: worker 1 buried after 1 seconds May 26 19:36:05.329506 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: worker 2 buried after 1 seconds May 26 19:36:05.329506 dv-cinder-825492-17-iscsi devstack@n-api.service[103936]: goodbye to uWSGI. May 26 19:36:05.330542 dv-cinder-825492-17-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 19:36:05.331137 dv-cinder-825492-17-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 19:36:05.333860 dv-cinder-825492-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 19:36:05.350051 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 19:36:05 2022] *** May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: nodename: dv-cinder-825492-17-iscsi May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: machine: x86_64 May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: clock source: unix May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: pcre jit disabled May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: detected number of CPU cores: 4 May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: current working directory: / May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: detected binary path: /usr/bin/uwsgi-core May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: your processes number limit is 47680 May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: your memory page size is 4096 bytes May 26 19:36:05.366709 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: detected max file descriptor number: 2048 May 26 19:36:05.367637 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: lock engine: pthread robust mutexes May 26 19:36:05.367637 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: thunder lock: enabled May 26 19:36:05.367637 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 19:36:05.367637 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 19:36:05.411358 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: Python main interpreter initialized at 0x559b625339c0 May 26 19:36:05.411358 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: python threads support enabled May 26 19:36:05.411358 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: your server socket listen backlog is limited to 100 connections May 26 19:36:05.411358 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: your mercy for graceful operations on workers is 90 seconds May 26 19:36:05.411815 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: mapped 403077 bytes (393 KB) for 2 cores May 26 19:36:05.411815 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: *** Operational MODE: preforking *** May 26 19:36:05.412075 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: *** uWSGI is running in multiple interpreter mode *** May 26 19:36:05.412075 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: spawned uWSGI master process (pid: 124864) May 26 19:36:05.412279 dv-cinder-825492-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 19:36:05.412843 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: spawned uWSGI worker 1 (pid: 124876, cores: 1) May 26 19:36:05.413332 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: spawned uWSGI worker 2 (pid: 124877, cores: 1) May 26 19:36:05.413608 dv-cinder-825492-17-iscsi devstack@n-api.service[124864]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 19:36:06.591113 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 19:36:06.602738 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 19:36:07.389599 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:36:07.389599 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: from cryptography.utils import int_from_bytes May 26 19:36:07.389993 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:36:07.389993 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: from cryptography.utils import int_from_bytes May 26 19:36:07.392228 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:36:07.392228 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: from cryptography.utils import int_from_bytes May 26 19:36:07.392579 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:36:07.392579 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: from cryptography.utils import int_from_bytes May 26 19:36:09.814376 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 19:36:09.815130 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 19:36:09.815255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 19:36:09.815530 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 19:36:09.815785 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 19:36:09.816174 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.816499 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.816820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.817138 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.817465 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.817794 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.818124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.818451 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.818779 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.819064 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.819386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.819502 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 19:36:09.819863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-17-iscsi {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.819941 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 19:36:09.820022 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.820221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 19:36:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.820587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 19:36:09.820692 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.820850 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 19:36:09.820946 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.821200 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.821302 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.821521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.821642 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.821825 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.821949 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.822165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.822329 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.822502 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.822810 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.823172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.823635 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.823839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.823958 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.824133 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.824254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.824430 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.824544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.824730 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-17-iscsi {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.824915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.825037 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.825212 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.825322 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.825521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.825642 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.825830 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.825937 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.826118 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.826352 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.826593 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.826832 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.827073 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.827306 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.827537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-17-iscsi {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.827774 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.828011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.828260 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.828479 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.828703 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.828939 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.829163 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.829372 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.829583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.829809 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.830028 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.830229 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.830419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.830609 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.830762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.830982 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.831137 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.831313 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.831463 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.831618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.831811 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.831969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.832125 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-17-iscsi {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.832280 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.832466 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.832622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.832779 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.832945 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.833145 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.833297 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.833444 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.833598 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.834264 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.834428 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.834575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.834721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.834721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.835065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.835809 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.835975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.836124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.836281 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.836434 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.836589 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.836743 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.837605 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.837777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.837932 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.838082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.838269 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.838429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.838587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.838734 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.838888 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.839092 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.839243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.839398 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.839544 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.839700 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.839846 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.840020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.840175 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.840322 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.840473 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.840630 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.840784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.840944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.841099 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.841253 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.841398 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.841551 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.841704 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.841866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.842034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.842183 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.842335 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.842483 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.842719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.842871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.843050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.843208 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.843363 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.843519 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.843666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.843818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.843985 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.844139 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.844287 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.844443 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.844590 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.844736 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.844881 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.845026 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.845179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.845914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.846081 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.846230 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.846392 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.846539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.846684 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.846846 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.847037 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.847193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.847347 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.847522 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.847762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.848488 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.848652 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.848811 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.848969 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.849117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.849272 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.849486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.850149 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.850556 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.850731 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.850880 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.851110 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.851272 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.851427 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.851590 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.851757 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.851905 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.852051 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.852196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.852357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.852514 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.852672 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.852827 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.852973 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.853128 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.853283 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.853439 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.853585 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.853743 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.853897 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.854044 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.854199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.854347 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.854492 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.854638 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.854791 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.854980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.855143 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.855298 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.856089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.856247 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.856414 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.856576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.856734 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.856893 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.857050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.857203 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.857358 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.857515 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.857662 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.857930 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.858095 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.858513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.858663 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.858821 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.859029 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.859199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.859361 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.860067 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.860227 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.860375 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.860521 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.860674 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.860836 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.860985 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.861132 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.861296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.861443 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.861595 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.861765 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.861913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.862079 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.862237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.862393 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.862539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.862704 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.862851 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.863043 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.863430 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.863626 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.863779 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.863931 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.864197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.864349 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.864495 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.864639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.864782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.864924 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.865091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.865286 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.865443 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.865911 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.866203 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.866346 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.866498 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.866651 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.866793 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.866983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.867138 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.867282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.867426 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.867579 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.867721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.867868 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.868052 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.868208 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.868363 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.868506 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.868654 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.868797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.868797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.869079 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.869231 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.869379 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.869523 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.869670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.869815 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.869971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.870122 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.870272 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.870414 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.870562 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.870718 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.870878 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.871046 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.871196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.871338 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.871486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.871637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:36:09.871794 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.871946 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.872095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.872244 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.872393 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.872543 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.872699 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.872842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.872989 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.873130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.873272 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.873420 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.873576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.873727 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.873886 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.874036 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.874189 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.874415 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.874574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.874733 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.874876 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.875078 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.875218 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.875362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.875513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.875663 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.875933 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.876081 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.876230 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.876440 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.876548 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.876638 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.876735 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.876822 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.876908 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877189 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877282 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877377 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877628 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877733 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.877917 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878013 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878108 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878204 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878347 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878347 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878517 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878706 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.878919 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879095 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879240 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879332 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879536 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879626 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879798 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879884 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.879983 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880071 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880260 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880356 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880443 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880538 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880655 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.880933 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881035 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881131 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881219 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881398 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881485 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881580 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881675 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881856 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.881950 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882132 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882228 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882322 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882515 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882607 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882795 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.882888 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883156 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883257 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883353 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883441 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883632 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883814 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.883909 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.884003 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.884098 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.884193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.884288 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.884424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.884566 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.884680 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.884770 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.884915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.885011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.885113 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.885238 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.885369 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.885483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.885608 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.885732 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.885848 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.886068 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.886201 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.886317 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.886456 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.886655 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.886782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.886914 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.887067 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.887183 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.887304 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.887430 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.887551 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.887664 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.887783 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.887901 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.888014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.888140 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.888254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.888366 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.888486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.888598 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.888719 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.888832 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.888951 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.889063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.889183 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.889295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.889421 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.889534 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.889675 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.889811 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.889960 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890094 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890236 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890329 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890755 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890755 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890755 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.890755 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.891214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.891307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.891409 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.891497 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.891582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.891675 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.891770 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.891864 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.892076 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.892200 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.892384 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.892487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.892695 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.892789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.893006 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.893109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.893314 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.893409 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.893621 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.893738 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.893932 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.894055 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.894240 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.894405 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.894547 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.894750 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.894874 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.895105 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.895438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.895760 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.896091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.896825 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.896969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.897115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.897364 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.897470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.897689 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.897796 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.898010 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.898115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.898340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.898434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.898660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.898769 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.899012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.899113 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.899333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.899428 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.899664 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.899768 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.899984 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.900649 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.900751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.900839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.900944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.901040 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.901127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.901213 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.901305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.901391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.901578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.901681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.901899 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.902005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.902217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.902316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.902531 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.902631 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.902848 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.902957 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.903202 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.903296 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.903518 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.903621 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.903831 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.903924 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.904141 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.904247 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.904461 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.904567 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.904775 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.904869 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.905096 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.905204 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.905409 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.905504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.905732 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.905866 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.906045 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.906149 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.906365 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.906468 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.906670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.906763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.907013 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.907137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.907330 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.907433 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.907650 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.907744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.907966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.908059 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.908279 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.908373 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.908601 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.908693 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.908912 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.909005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.909223 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.909325 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.909535 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.909629 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.909844 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.909939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.910191 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.910300 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.910459 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.910597 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.910782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.910877 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.911119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.911214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.911432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.911544 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.911740 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.911834 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.912603 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.912760 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.912920 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.913058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.913229 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.913351 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.913535 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.913633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.913843 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.913950 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.914155 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.914258 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.914467 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.914568 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.914785 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.914887 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.915131 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.915225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.915440 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.915538 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.915744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.915847 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.916061 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.916160 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.916369 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.916460 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.916675 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.916769 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.916976 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.917127 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.917281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.917383 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.917606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.917707 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.917926 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.918018 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.918230 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.918325 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.918546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.918859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.918983 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.919192 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.919292 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.919506 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.919600 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.919816 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.919955 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.920124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.920287 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.920448 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.920602 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.920749 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.920887 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.921053 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.921165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.921363 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.921466 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.921672 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.921774 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.921984 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.922089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.922296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.922397 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.922606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.922705 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.922944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.923097 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.923249 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.923351 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.923560 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.923660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.923860 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.923955 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.924171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.924271 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.924487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.924589 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.924800 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.925071 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.925167 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.925404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.925536 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.925716 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.925856 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.926031 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.926125 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.926343 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.926443 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.926657 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.926753 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.926995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.927092 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.927310 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.927450 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.927650 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.927761 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.927968 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.928087 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.928278 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.928545 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.928647 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.928872 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.928981 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.929180 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.929293 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.929486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.929589 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.929794 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.929904 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.930100 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.930216 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.930408 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.930520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.930801 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.931014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.931133 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.931224 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.931338 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.931447 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.931641 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.931744 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.931953 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.932058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.932257 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.932363 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.932567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.932661 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.932870 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.932972 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.933187 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.933290 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.933492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.933584 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.933795 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.933890 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.934097 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.934202 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.934399 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.934495 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.934703 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.934796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.935037 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.935144 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.935358 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.935453 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.935666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.935776 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.935982 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.936079 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.936290 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.936393 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.936602 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.936703 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.936914 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.937008 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.937215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.937345 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.937520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.937623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.937821 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.937917 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.938128 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.938222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.938434 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.938637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.938737 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.938825 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.939106 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.939218 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.939429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.939533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.939739 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.939842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.940049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.940144 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.940409 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.940561 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.940666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.940777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.941042 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.941183 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.941281 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.941378 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.941549 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.941652 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.941852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.941954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.942157 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.942257 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.942465 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.942566 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.942775 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.942869 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.943102 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.943218 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.943435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.943538 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.943741 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.943841 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.944057 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.944159 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.944362 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.944456 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.944666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.944761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.944969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.945071 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.945275 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.945367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.945580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.945681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.945883 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.945989 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.946194 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.946286 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.946501 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.946644 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.946804 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.946931 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.947131 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.947227 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.947442 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.947563 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.947744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.947838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.948051 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.948145 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.948355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.948461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.948666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.948762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.948977 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.949080 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.949279 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.949373 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.949590 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.949683 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.949894 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.949989 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.950199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.950294 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.950523 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.950666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.950808 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.950942 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.951127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.951228 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.951429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.951536 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.951730 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.951832 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.952033 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.952136 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.952338 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.952441 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.952661 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.952770 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.952971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.953071 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.953279 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.953373 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.953587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.953757 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.953890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.953991 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.954200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.954292 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.954508 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.954616 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.954817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.954935 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.955151 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.955257 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.955462 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.955566 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.955771 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.955875 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.956099 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.956202 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.956411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.956507 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.956719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.956812 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.957020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.957120 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.957329 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.957538 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.957639 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.957725 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.957932 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.958035 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.958235 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.958330 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.958537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.958631 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.959401 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.959522 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.959721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.959817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.960034 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.960129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.960356 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.960458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.960687 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.960801 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.960988 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.961082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.961296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.961530 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.961626 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.961722 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.961900 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.961997 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.962207 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.962309 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.962514 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.962618 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.962822 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.962932 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.963156 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.963266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.963467 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.963562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.963780 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.963874 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.964091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.964195 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.964401 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.964496 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.964707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.964800 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.965012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.965107 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.965319 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.965413 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.965620 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.965722 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.965929 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.966031 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.966235 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.966327 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.966537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.966632 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.966843 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.966967 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.967184 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.967277 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.967490 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.967605 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.967795 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.967901 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.968103 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.968204 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.968417 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.968526 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.968730 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.968833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.969038 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.969134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.969365 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.969474 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.969678 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.969773 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.969985 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.970088 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.970296 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.970404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.970601 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.970709 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.970951 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.971058 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.971243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.971354 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.971643 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.971744 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.971954 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.972048 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.972258 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.972353 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.972559 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.972654 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.972870 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.972964 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.973183 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.973285 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.973483 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.973584 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.973785 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.973879 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.974085 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.974181 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.974432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.975050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.975293 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.975402 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.975616 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.975713 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.975987 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.976081 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.976297 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.976407 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.976603 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.976699 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.976918 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.977012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.977247 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.977351 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.977556 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.977659 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.977872 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.977985 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.978177 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.978283 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.978504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.978607 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.978813 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.978929 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.979167 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.979274 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.979479 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.979636 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.979790 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.979947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.980103 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.980250 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.980389 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.980594 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.980775 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.981024 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.981189 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.981334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.981488 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.981631 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.981780 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.981874 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.981969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.982168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.982309 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.982477 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.982611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.982796 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.982954 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.983133 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.983520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.983717 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.983896 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.984044 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.984146 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.984359 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.984454 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.984674 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.984778 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.984981 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.985084 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.985307 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.985403 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.985609 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.985711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.985932 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.986028 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.986235 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.986337 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.986547 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.986642 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.986857 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.987000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.987190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.987318 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.987493 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.987643 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.987794 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.987978 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.988116 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.988287 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.988417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.988594 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.988737 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.988907 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.989048 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.989217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.989368 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.989526 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.989687 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.989852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.989991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.990185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.990352 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.990502 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.990667 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.990808 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.990980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.991214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.991314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.991438 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.991577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.991743 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.991912 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.992069 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.992217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.992375 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.992536 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.992699 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.992861 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.993017 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.993188 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.993342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.993496 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.993667 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.993825 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.993976 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.994147 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.994301 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.994462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.994613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.994779 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.994936 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.995138 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.995234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.995442 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.995538 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.995744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.995878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.996051 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.996187 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.996354 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.996508 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.996657 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.996838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.996961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.997168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.997270 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.997483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.997588 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.997824 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.997919 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.998125 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.998213 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.998444 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.998547 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.998747 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.998841 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.999092 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.999190 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.999400 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.999494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.999702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:09.999803 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.000006 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.000110 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.000306 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.000408 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.000609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.000703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.000915 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.001070 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.001220 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.001321 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.001519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.001676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.001823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.001970 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.002129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.002234 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.002453 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.002593 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.002761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.002866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.003112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.003207 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.003424 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.003528 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.003733 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.003837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.004041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.004136 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.004345 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.004441 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.004657 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.004752 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.004971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.005067 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.005279 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.005381 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.005592 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.005709 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.005943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.006037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.006276 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.006371 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.006589 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.006796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.006931 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.007148 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.007244 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.007461 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.007557 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.007773 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.007876 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.008084 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.008218 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.008397 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.008493 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.008706 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.008801 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.009014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.009117 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.009321 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.009417 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.009628 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.009722 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.009935 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.010037 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.010259 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.010355 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.010584 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.010797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.010893 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.011159 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.011292 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.011479 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.011589 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.011799 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.011915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.012112 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.012215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.012429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.012531 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.012747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.012854 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.013062 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.013160 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.013376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.013508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.013686 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.013789 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.013999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.014100 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.014308 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.014401 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.014620 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.014725 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.014966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.015079 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.015271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.015367 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.015582 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.015686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.015890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.015987 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.016199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.016301 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.016512 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.016609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.016825 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.016922 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.017149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.017254 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.017482 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.017587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.017798 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.017893 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.018108 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.018217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.018423 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.018593 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.018757 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.018860 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.019084 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.019265 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.019406 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.019577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.019724 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.019906 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.020038 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.020227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.020352 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.020556 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.020673 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.020873 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.020978 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.021189 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.021809 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.022034 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.022177 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.022342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.022513 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.022683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.022852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.023042 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.023189 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.023333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.023492 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.023591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.023853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.023997 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.024147 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.024304 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.024454 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.024599 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.024753 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.024894 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.025049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.025205 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.025501 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.025654 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.025825 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.025978 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.026158 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.026400 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.026513 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.026603 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.026767 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.026864 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.027109 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.027224 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.027424 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.027537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.027734 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.027839 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.028037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.028133 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.028388 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.028505 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.028652 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.028760 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.028962 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.029067 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.029264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.029360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.029567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.029801 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.029918 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.030153 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.030250 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.030460 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.030553 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.030772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.030879 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.031104 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.031200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.031427 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.031524 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.031730 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.031826 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.032126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.032236 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.032339 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.032435 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.032626 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.032738 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.032930 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.033026 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.033231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.033334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.033534 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.033631 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.033836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.033954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.034145 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.034240 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.034445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.034550 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.034750 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.034845 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.035074 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.035196 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.035384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.035480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.035685 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.035780 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.035992 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.036096 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.036297 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.036391 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.036604 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.036706 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.036967 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.037571 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.037769 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.037878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.038082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.038178 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.038392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.038512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.038701 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.038809 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.039033 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.039142 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.039342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.039437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.039657 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.039769 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.039965 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.040061 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.040281 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.040512 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.040609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.040849 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.040945 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.041171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.041281 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.041504 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.041600 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.041830 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.041923 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.042139 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.042268 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.042448 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.042651 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.042794 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.042988 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.043231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.043327 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.043416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.043504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.043684 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.043781 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.043992 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.044095 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.044301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.044404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.044609 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.044875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.044987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.045213 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.045309 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.045521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.045616 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.045830 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.045934 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.046138 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.046234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.046448 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.046544 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.046756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.046865 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.047091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.047199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.047410 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.047514 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.047723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.047826 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.048039 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.048142 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.048357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.048451 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.048670 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.048830 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.048982 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.049077 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.049292 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.049396 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.049598 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.049700 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.049907 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.050009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.050213 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.050322 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.050524 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.050618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.050838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.050954 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.051179 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.051287 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.051486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.051581 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.051803 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.051897 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.052166 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.052292 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.052465 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.052640 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.052833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.052927 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.053141 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.053288 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.053461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.053556 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.053775 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.053879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.054085 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.054189 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.054394 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.054488 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.054699 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.054807 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.055040 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.055138 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.055374 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.055470 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.055691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.055805 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.056003 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.056100 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.056305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.056421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.056608 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.056737 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.056909 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.057058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.057214 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.057413 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.057581 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.057732 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.057883 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.058034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.058178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.058320 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.058476 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.058621 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.058783 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.059006 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.059149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.059326 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.059484 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.059632 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.059774 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.059929 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.060078 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.060220 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.060379 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.060529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.060671 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.060813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.060961 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.061116 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.061276 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.061420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.061567 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.061711 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.061858 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.062010 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.062153 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.062263 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.062473 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.062613 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.062762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.062865 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.062961 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.063111 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.063215 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.063383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.063504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.063682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.063812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.064009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.064106 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.064341 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.064492 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.064654 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.064751 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.064974 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.065070 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.065285 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.065389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.065588 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.065695 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.065895 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.065999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.066201 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.066306 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.066509 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.066605 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.066820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.066934 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.067153 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.067258 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.067459 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.067561 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.067766 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.067862 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.068073 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.068195 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.068411 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.068513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.068717 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.068871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.069026 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.069130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.069333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.069428 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.069661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.069756 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.069982 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.070088 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.070284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.070386 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.070606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.070714 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.070961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.071060 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.071264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.071360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.071579 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.071755 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.071887 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.071993 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.072215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.072311 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.072586 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.072705 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.072849 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.072941 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.073136 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.073248 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.073445 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.073592 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.073754 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.074140 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.074326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.074463 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.074797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.074927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.075160 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.075471 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.075567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.075801 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.075912 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.076127 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.076232 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.076476 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.076809 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.077165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.077486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.077836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.078169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.078488 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.078805 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.079138 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.079388 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 19:36:10.081428 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.081428 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.081428 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.081428 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.081778 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.081868 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.082197 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.082538 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.082871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.083231 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.083566 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.084448 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.084792 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.085119 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.085461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.085841 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.086163 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.088746 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.088746 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.088746 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.088746 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.088746 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.088746 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:36:10.088746 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 19:36:10.143808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO dbcounter [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Registered counter for database nova_api May 26 19:36:10.148191 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO dbcounter [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Registered counter for database nova_api May 26 19:36:10.165591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_db.sqlalchemy.engines [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:36:10.168518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_db.sqlalchemy.engines [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:36:10.173155 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writer thread running {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:36:10.174821 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writer thread running {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:36:10.231479 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.context [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1f15ba6-4bbf-4710-a76f-47f056c03285(cell1) {{(pid=124876) load_cells /opt/stack/nova/nova/context.py:464}} May 26 19:36:10.233056 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.context [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1f15ba6-4bbf-4710-a76f-47f056c03285(cell1) {{(pid=124877) load_cells /opt/stack/nova/nova/context.py:464}} May 26 19:36:10.235997 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:36:10.237522 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:36:10.237632 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:36:10.238361 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:36:10.239109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:36:10.239915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:36:10.240396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:36:10.241881 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:36:10.242382 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO dbcounter [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Registered counter for database nova_cell0 May 26 19:36:10.243883 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO dbcounter [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Registered counter for database nova_cell0 May 26 19:36:10.246409 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO dbcounter [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Registered counter for database nova_cell1 May 26 19:36:10.247991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO dbcounter [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Registered counter for database nova_cell1 May 26 19:36:10.253999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_db.sqlalchemy.engines [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:36:10.256389 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_db.sqlalchemy.engines [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:36:10.258075 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_db.sqlalchemy.engines [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:36:10.259997 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writer thread running {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:36:10.260637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_db.sqlalchemy.engines [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:36:10.263246 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writer thread running {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:36:10.405920 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writer thread running {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:36:10.410917 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writer thread running {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:36:10.416444 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO dbcounter [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Registered counter for database nova_cell0 May 26 19:36:10.420362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO dbcounter [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Registered counter for database nova_cell0 May 26 19:36:10.423849 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_db.sqlalchemy.engines [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:36:10.429880 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writer thread running {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:36:10.430804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_db.sqlalchemy.engines [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:36:10.436989 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writer thread running {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:36:10.751934 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: WARNING keystonemiddleware.auth_token [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 19:36:10.757953 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: WARNING keystonemiddleware.auth_token [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 19:36:10.760038 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: WARNING keystonemiddleware.auth_token [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 19:36:10.765295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: WARNING keystonemiddleware.auth_token [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 19:36:11.116339 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: WARNING keystonemiddleware.auth_token [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 19:36:11.117509 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: WARNING keystonemiddleware.auth_token [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 19:36:11.122805 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: WARNING keystonemiddleware.auth_token [None req-e4ed12fc-4a42-4e82-977a-f45a399cec80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 19:36:11.123524 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: WARNING keystonemiddleware.auth_token [None req-b9cc8bba-0cd3-4759-b6ac-f7905327c82e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 19:36:11.128243 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b625339c0 pid: 124877 (default app) May 26 19:36:11.128823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b625339c0 pid: 124876 (default app) May 26 19:36:52.733996 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:52.735422 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:52.736966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:52.739080 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:53.306717 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=3 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:53.311110 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=3 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:53.311110 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=3 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:53.311110 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=3 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:54.325194 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fc9d14a2-a14b-4bc8-8180-05ac6aec5ae3 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] Action: 'create', calling method: .version_select at 0x7fa789ad7ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1128941451", "metadata": {"Type": "work"}}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:36:54.543181 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-be5b1a03-a475-4e9b-b7e3-1c78fcef79a5 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Action: 'create', calling method: .version_select at 0x7fa789ad5d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1954640748"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:36:56.620437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fc9d14a2-a14b-4bc8-8180-05ac6aec5ae3 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.899400 May 26 19:36:56.622052 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 1/1] 10.222.0.72 () {60 vars in 1155 bytes} [Thu May 26 19:36:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3903 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 19:36:56.737173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-594012023", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "networks": [{"uuid": "2fc14c16-c329-476d-bfe9-2e3d746cc6bf"}]}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:36:56.782889 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-be5b1a03-a475-4e9b-b7e3-1c78fcef79a5 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.487600 May 26 19:36:56.790392 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 1/2] 10.222.0.72 () {60 vars in 1154 bytes} [Thu May 26 19:36:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3490 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 26 19:36:56.796537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-99a3ad8f-c0f3-4a2e-a357-c2cf7af82b31 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] Calling method '.version_select at 0x7fa789926ca0>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:56.922210 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-99a3ad8f-c0f3-4a2e-a357-c2cf7af82b31 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b" status: 200 len: 353 microversion: 2.1 time: 0.137118 May 26 19:36:56.922978 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:36:56 2022] GET /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:36:56.932797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f54f6174-2eeb-4f74-a9da-5e4c683f072d tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa789926d30>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:56.961134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] validate_networks() for [('2fc14c16-c329-476d-bfe9-2e3d746cc6bf', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:36:57.128144 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f54f6174-2eeb-4f74-a9da-5e4c683f072d tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f" status: 200 len: 345 microversion: 2.1 time: 0.199313 May 26 19:36:57.128875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 3/4] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:36:56 2022] GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f => generated 345 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:36:57.655193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e6b2abdb-c5df-478a-9da6-095267b40b5a tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa7899384c0>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:57.798347 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e6b2abdb-c5df-478a-9da6-095267b40b5a tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/618f63e0-7893-47b3-8528-829f32ec2084" status: 200 len: 350 microversion: 2.1 time: 0.147692 May 26 19:36:57.800767 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 4/5] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:36:57 2022] GET /compute/v2.1/os-volumes/618f63e0-7893-47b3-8528-829f32ec2084 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:36:57.935604 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-85b4efa1-6826-40fc-b7c3-b1c7ece8afb3 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] Calling method '.version_select at 0x7fa789938c10>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:58.058170 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-85b4efa1-6826-40fc-b7c3-b1c7ece8afb3 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b" status: 200 len: 354 microversion: 2.1 time: 0.127002 May 26 19:36:58.059105 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 5/6] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:36:57 2022] GET /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:36:58.073612 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5162e3e8-1b24-47f4-8b6e-8d55ecbeca7f tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] Calling method '.version_select at 0x7fa789938b80>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:58.198869 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5162e3e8-1b24-47f4-8b6e-8d55ecbeca7f tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b" status: 200 len: 354 microversion: 2.1 time: 0.132220 May 26 19:36:58.200356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 6/7] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:36:58 2022] GET /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:36:58.208425 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-67bbcda9-fc88-40e1-bbc1-d30860af0e59 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa789938430>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:58.281228 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-67bbcda9-fc88-40e1-bbc1-d30860af0e59 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f" status: 200 len: 346 microversion: 2.1 time: 0.079387 May 26 19:36:58.287707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 7/8] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:36:58 2022] GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:36:58.296024 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-38e22f10-3238-4ab5-9c7b-f1e87822572a tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] Calling method '.version_select at 0x7fa789926c10>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:58.603999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:36:58.611869 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:36:58.613542 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:36:58.614328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:36:58.615565 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:36:58.706449 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-38e22f10-3238-4ab5-9c7b-f1e87822572a tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b" status: 202 len: 0 microversion: 2.1 time: 0.417493 May 26 19:36:58.713161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 8/9] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:36:58 2022] DELETE /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:36:58.718315 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3a5fabd6-64d0-42f5-8326-e736bba2377a tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Action: 'create', calling method: .version_select at 0x7fa789926ee0>, body: {"snapshot": {"volume_id": "f043a01b-d751-4f95-b7de-b0b918a85f4f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1747883134"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:36:58.732308 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:36:58.735989 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:36:58.737278 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:36:58.748123 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:36:58.881608 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Getting quotas for project 5da3140c3a1145dda3ef03959eb8a937. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:36:58.896918 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Getting quotas for user 73b118c9debc47a6893cca0d336e4897 and project 5da3140c3a1145dda3ef03959eb8a937. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:36:58.924078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:36:58.927515 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:36:59.150893 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d3b562e6-48ab-4b0b-9677-dcf4d6508dc0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.527082 May 26 19:36:59.159570 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 2/10] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:36:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:36:59.165117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7a20cdb6-5dc4-40b3-81ad-ebadd4abaa11 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] Calling method '.version_select at 0x7fa78903c700>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:59.577862 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-7a20cdb6-5dc4-40b3-81ad-ebadd4abaa11 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] HTTP exception thrown: Volume c6879e77-d6b5-41cc-ab25-4c5d8981318b could not be found. May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7a20cdb6-5dc4-40b3-81ad-ebadd4abaa11 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] Request method failure captured: May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b HTTP/1.1 May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bU_5SfxCd6DnZJEHJH45c2wS-PlLWU_AUkIz6vaDh1LdCER4T2aEEbIx0HYEooFyggsVxagIm7U_dpzSWfDgGoJQEeLB-ODScN6XM2H8IGrCHLJo1ke_uixXUwcwVVwHmKL4IykBfOpR6pkIiESUHPGAIEyb_SISZgtOl2zcbvNhk May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: a59216e3194d4d809b9df8eb09b34636 May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesGetTestJSON-269434329 May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:36:59.585112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a59216e3194d4d809b9df8eb09b34636"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a59216e3194d4d809b9df8eb09b34636"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a59216e3194d4d809b9df8eb09b34636", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a59216e3194d4d809b9df8eb09b34636"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesGetTestJSON-269434329 May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: a59216e3194d4d809b9df8eb09b34636 May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesGetTestJSON-269434329 May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesGetTestJSON-269434329-project May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: dc50b532d2d94fbc947c151a08e557bb May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesGetTestJSON-269434329-project May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Volume c6879e77-d6b5-41cc-ab25-4c5d8981318b could not be found. May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'c6879e77-d6b5-41cc-ab25-4c5d8981318b'} May 26 19:36:59.586591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6879e77-d6b5-41cc-ab25-4c5d8981318b could not be found. (HTTP 404) (Request-ID: req-7a5e43ce-8dd7-48b7-8dc4-ae831768ea54) May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:36:59.587392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:36:59.588576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6879e77-d6b5-41cc-ab25-4c5d8981318b could not be found. May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 19:36:59.589702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6879e77-d6b5-41cc-ab25-4c5d8981318b could not be found. May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6879e77-d6b5-41cc-ab25-4c5d8981318b could not be found. May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7a20cdb6-5dc4-40b3-81ad-ebadd4abaa11 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] Returning 404 to user: Volume c6879e77-d6b5-41cc-ab25-4c5d8981318b could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7a20cdb6-5dc4-40b3-81ad-ebadd4abaa11 tempest-VolumesGetTestJSON-269434329 tempest-VolumesGetTestJSON-269434329-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b" status: 404 len: 109 microversion: 2.1 time: 0.423185 May 26 19:36:59.590969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 3/11] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:36:59 2022] GET /compute/v2.1/os-volumes/c6879e77-d6b5-41cc-ab25-4c5d8981318b => generated 109 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:36:59.608589 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d97941d7-91be-4265-b955-0deecd9f527f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:59.613442 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d97941d7-91be-4265-b955-0deecd9f527f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:36:59.628065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3a5fabd6-64d0-42f5-8326-e736bba2377a tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.913282 May 26 19:36:59.628645 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 9/12] 10.222.0.72 () {60 vars in 1161 bytes} [Thu May 26 19:36:58 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:36:59.652044 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3be0c52e-8d30-4255-b180-2fdcf35c33a4 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa7899389d0>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:59.738298 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3be0c52e-8d30-4255-b180-2fdcf35c33a4 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef" status: 200 len: 287 microversion: 2.1 time: 0.095061 May 26 19:36:59.739057 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 10/13] 10.222.0.72 () {58 vars in 1250 bytes} [Thu May 26 19:36:59 2022] GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:36:59.749235 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3aec20fe-f82b-48e9-90df-cdccdc5e20d1 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa78994a280>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:36:59.949574 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3aec20fe-f82b-48e9-90df-cdccdc5e20d1 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.204006 May 26 19:36:59.950300 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 11/14] 10.222.0.72 () {58 vars in 1139 bytes} [Thu May 26 19:36:59 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:36:59.955752 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-009784ba-98b6-473a-a6e7-809cfc26f99c tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa789926af0>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:00.077100 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-009784ba-98b6-473a-a6e7-809cfc26f99c tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b86fde9e-b715-44d7-8b3d-b1b03da2a70c" status: 200 len: 350 microversion: 2.1 time: 0.125399 May 26 19:37:00.083684 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 12/15] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:36:59 2022] GET /compute/v2.1/os-volumes/b86fde9e-b715-44d7-8b3d-b1b03da2a70c => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:00.083684 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0a967299-44bf-42df-af8d-5681528078b9 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa78994a9d0>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:00.155185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0a967299-44bf-42df-af8d-5681528078b9 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef" status: 200 len: 287 microversion: 2.1 time: 0.075860 May 26 19:37:00.155762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 13/16] 10.222.0.72 () {58 vars in 1250 bytes} [Thu May 26 19:37:00 2022] GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:00.167646 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d97941d7-91be-4265-b955-0deecd9f527f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:00.231955 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d97941d7-91be-4265-b955-0deecd9f527f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1214 microversion: 2.1 time: 0.632864 May 26 19:37:00.257721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 4/17] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:36:59 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1214 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:01.172657 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a641e880-335c-4c21-bd72-4451ddaec100 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa78994a040>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:01.278363 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d19e8f24-3e5f-4f8e-bcba-e16835ac2f4b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:01.279043 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d19e8f24-3e5f-4f8e-bcba-e16835ac2f4b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:01.284430 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a641e880-335c-4c21-bd72-4451ddaec100 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef" status: 200 len: 287 microversion: 2.1 time: 0.116373 May 26 19:37:01.292128 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 14/18] 10.222.0.72 () {58 vars in 1250 bytes} [Thu May 26 19:37:01 2022] GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:01.366123 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d19e8f24-3e5f-4f8e-bcba-e16835ac2f4b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:01.373048 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d19e8f24-3e5f-4f8e-bcba-e16835ac2f4b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1214 microversion: 2.1 time: 0.098570 May 26 19:37:01.381567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 5/19] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:01 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:02.300380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-87c47a96-5f9b-4efa-96db-5559ce88aeaa tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa788766430>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:02.356847 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-87c47a96-5f9b-4efa-96db-5559ce88aeaa tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef" status: 200 len: 287 microversion: 2.1 time: 0.063277 May 26 19:37:02.361613 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 6/20] 10.222.0.72 () {58 vars in 1250 bytes} [Thu May 26 19:37:02 2022] GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:02.390974 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0ec00182-c14b-465f-b5f0-7bc8dbf2742e tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:02.391971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0ec00182-c14b-465f-b5f0-7bc8dbf2742e tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:02.405109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0ec00182-c14b-465f-b5f0-7bc8dbf2742e tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:02.405854 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0ec00182-c14b-465f-b5f0-7bc8dbf2742e tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:02.408080 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0ec00182-c14b-465f-b5f0-7bc8dbf2742e tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:02.408685 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0ec00182-c14b-465f-b5f0-7bc8dbf2742e tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:02.439278 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d786ee42-120a-402e-a676-6a095d082c94 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: .version_select at 0x7fa78994b160>, body: {"keypair": {"name": "tempest-keypair-437929174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzEIiQty1K+ShJfZnUYn3TxETb4LBW/Sma+OMmFznkls3wwyZ7V3TGHSM7yUJ0KlzYEvGiNjszMXYdpom7TBzj8a8rMIepZKj7tSh+0tGl9iD8vRWjKeSRIIQjZyaNug=="}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:02.528214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-d786ee42-120a-402e-a676-6a095d082c94 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:37:02.535399 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-d786ee42-120a-402e-a676-6a095d082c94 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for user 841abe37b81f47d2a95140e46b12ea08 and project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:37:02.666934 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0ec00182-c14b-465f-b5f0-7bc8dbf2742e tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:02.686267 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0ec00182-c14b-465f-b5f0-7bc8dbf2742e tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1218 microversion: 2.1 time: 0.299077 May 26 19:37:02.688043 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 7/21] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:02 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1218 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:02.753109 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d786ee42-120a-402e-a676-6a095d082c94 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.559548 May 26 19:37:02.759131 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 15/22] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:37:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:03.384240 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8992617c-0d7a-42d4-947c-8f26ffd34215 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa788753b80>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:03.488760 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8992617c-0d7a-42d4-947c-8f26ffd34215 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef" status: 200 len: 288 microversion: 2.1 time: 0.122586 May 26 19:37:03.492140 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 8/23] 10.222.0.72 () {58 vars in 1250 bytes} [Thu May 26 19:37:03 2022] GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef => generated 288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:03.501853 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6d2dcd30-2228-4ed5-be7b-eaed3bfd3c3d tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa7898a6790>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:03.705232 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-38829dda-ae09-4a18-995e-8994fd6e59cc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:03.706677 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-38829dda-ae09-4a18-995e-8994fd6e59cc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:03.716364 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6d2dcd30-2228-4ed5-be7b-eaed3bfd3c3d tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef" status: 202 len: 0 microversion: 2.1 time: 0.219671 May 26 19:37:03.717209 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 16/24] 10.222.0.72 () {58 vars in 1253 bytes} [Thu May 26 19:37:03 2022] DELETE /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:37:03.726668 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-38829dda-ae09-4a18-995e-8994fd6e59cc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:03.727399 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-38829dda-ae09-4a18-995e-8994fd6e59cc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:03.727528 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-129dd951-7843-4456-b85d-ab224048b261 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa7898a6dc0>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:03.728924 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-38829dda-ae09-4a18-995e-8994fd6e59cc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:03.729521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-38829dda-ae09-4a18-995e-8994fd6e59cc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:03.782931 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-129dd951-7843-4456-b85d-ab224048b261 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef" status: 200 len: 287 microversion: 2.1 time: 0.059899 May 26 19:37:03.787517 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 17/25] 10.222.0.72 () {58 vars in 1250 bytes} [Thu May 26 19:37:03 2022] GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:37:03.899552 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-38829dda-ae09-4a18-995e-8994fd6e59cc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:03.910524 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-38829dda-ae09-4a18-995e-8994fd6e59cc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1210 microversion: 2.1 time: 0.209653 May 26 19:37:03.921164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 9/26] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:03 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1210 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:04.217396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c37327ee-43b4-42bb-a90e-14268fbb6618 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa7898cf4c0>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:04.379467 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c37327ee-43b4-42bb-a90e-14268fbb6618 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/6236ab53-d614-4d57-9354-3aee593d433d" status: 200 len: 350 microversion: 2.1 time: 0.170574 May 26 19:37:04.380076 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 18/27] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:37:04 2022] GET /compute/v2.1/os-volumes/6236ab53-d614-4d57-9354-3aee593d433d => generated 350 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:04.392070 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-750d8d01-b290-41fc-bed2-c4fffee6d82b tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa789916f70>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:04.560294 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a3d8451f-460e-484b-8be5-cb7e66e8ef0f tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Action: 'create', calling method: .version_select at 0x7fa788766f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-651111582", "metadata": {"Type": "work"}}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a3d8451f-460e-484b-8be5-cb7e66e8ef0f tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Request method failure captured: May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 121 May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bgat3c7zscFOivnJj_u5bVpcy_VEI8P_UbupUkogQ9b--mIZK4UGc1IeiFTvPOyLCpqMD1vb2DAyGvVAapOueXynz15iPpngN6_sJyGiuIbv6XT4mo2pB6lQtNzq9cy1Rigc5_hV-tbenmKbnC9dr6FYNpYDVtxIpnd6BatBsNyVY May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:37:04.577094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1bce8858c2aa453fb5d1fa3fb92f5a9c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: d31f924fba7c4a7aa23acc1712e0d487 May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-651111582", "metadata": {"Type": "work"}}} May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:37:04.578424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-651111582', 'metadata': {'Type': 'work'}}}} May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise error May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi '#$%' May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:04.579301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 19:37:04.580578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 19:37:04.581703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 19:37:04.581703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.585078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a3d8451f-460e-484b-8be5-cb7e66e8ef0f tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:04.594302 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a3d8451f-460e-484b-8be5-cb7e66e8ef0f tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.358806 May 26 19:37:04.599027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 10/28] 10.222.0.72 () {60 vars in 1155 bytes} [Thu May 26 19:37:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 372 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 19:37:04.610992 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-cd0bf391-b405-44b1-9573-df728f94339e tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Action: 'create', calling method: .version_select at 0x7fa7886da9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1451386108", "metadata": {"Type": "work"}}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-cd0bf391-b405-44b1-9573-df728f94339e tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Request method failure captured: May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 120 May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bgat3c7zscFOivnJj_u5bVpcy_VEI8P_UbupUkogQ9b--mIZK4UGc1IeiFTvPOyLCpqMD1vb2DAyGvVAapOueXynz15iPpngN6_sJyGiuIbv6XT4mo2pB6lQtNzq9cy1Rigc5_hV-tbenmKbnC9dr6FYNpYDVtxIpnd6BatBsNyVY May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:37:04.615703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1bce8858c2aa453fb5d1fa3fb92f5a9c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: d31f924fba7c4a7aa23acc1712e0d487 May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1451386108", "metadata": {"Type": "work"}}} May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:37:04.616994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1451386108', 'metadata': {'Type': 'work'}}}} May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise error May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi '0' May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:04.617772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 19:37:04.619110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 19:37:04.620215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 19:37:04.620215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.620681 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-cd0bf391-b405-44b1-9573-df728f94339e tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:04.621935 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-cd0bf391-b405-44b1-9573-df728f94339e tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020322 May 26 19:37:04.622674 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 11/29] 10.222.0.72 () {60 vars in 1155 bytes} [Thu May 26 19:37:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 19:37:04.624803 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-750d8d01-b290-41fc-bed2-c4fffee6d82b tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.236497 May 26 19:37:04.633484 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 19/30] 10.222.0.72 () {58 vars in 1133 bytes} [Thu May 26 19:37:04 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:04.643019 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6b224591-1c0e-4896-8ac1-92b89199da93 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa7898a6160>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:04.663064 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-48dc1cd1-4338-4174-8ff7-b60b2efe4467 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Action: 'create', calling method: .version_select at 0x7fa78879d700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-874517159", "metadata": {"Type": "work"}}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-48dc1cd1-4338-4174-8ff7-b60b2efe4467 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Request method failure captured: May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 118 May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bgat3c7zscFOivnJj_u5bVpcy_VEI8P_UbupUkogQ9b--mIZK4UGc1IeiFTvPOyLCpqMD1vb2DAyGvVAapOueXynz15iPpngN6_sJyGiuIbv6XT4mo2pB6lQtNzq9cy1Rigc5_hV-tbenmKbnC9dr6FYNpYDVtxIpnd6BatBsNyVY May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:37:04.666227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1bce8858c2aa453fb5d1fa3fb92f5a9c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: d31f924fba7c4a7aa23acc1712e0d487 May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-874517159", "metadata": {"Type": "work"}}} May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:37:04.667437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-874517159', 'metadata': {'Type': 'work'}}}} May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise error May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi '' May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:04.668066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 19:37:04.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 19:37:04.670164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 19:37:04.670164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.670164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-48dc1cd1-4338-4174-8ff7-b60b2efe4467 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:04.670164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-48dc1cd1-4338-4174-8ff7-b60b2efe4467 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029871 May 26 19:37:04.671047 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 12/31] 10.222.0.72 () {60 vars in 1155 bytes} [Thu May 26 19:37:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 19:37:04.681618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-76b6bf0b-1a38-4653-b4fa-7b782faa5be1 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Calling method '.version_select at 0x7fa788753940>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:04.747687 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-76b6bf0b-1a38-4653-b4fa-7b782faa5be1 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] HTTP exception thrown: Volume tempest-invalid-446616402 could not be found. May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-76b6bf0b-1a38-4653-b4fa-7b782faa5be1 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Request method failure captured: May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-446616402 HTTP/1.1 May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bgat3c7zscFOivnJj_u5bVpcy_VEI8P_UbupUkogQ9b--mIZK4UGc1IeiFTvPOyLCpqMD1vb2DAyGvVAapOueXynz15iPpngN6_sJyGiuIbv6XT4mo2pB6lQtNzq9cy1Rigc5_hV-tbenmKbnC9dr6FYNpYDVtxIpnd6BatBsNyVY May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:37:04.750867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1bce8858c2aa453fb5d1fa3fb92f5a9c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: d31f924fba7c4a7aa23acc1712e0d487 May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Volume tempest-invalid-446616402 could not be found. May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'tempest-invalid-446616402'} May 26 19:37:04.755093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-446616402 could not be found. (HTTP 404) (Request-ID: req-4107db74-0c34-4c9c-97bd-d0983fcc3949) May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.756944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 19:37:04.758165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-446616402 could not be found. May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:37:04.759971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-446616402 could not be found. May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-446616402 could not be found. May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-76b6bf0b-1a38-4653-b4fa-7b782faa5be1 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Returning 404 to user: Volume tempest-invalid-446616402 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:04.761417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-76b6bf0b-1a38-4653-b4fa-7b782faa5be1 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-446616402" status: 404 len: 98 microversion: 2.1 time: 0.077793 May 26 19:37:04.763449 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 13/32] 10.222.0.72 () {58 vars in 1214 bytes} [Thu May 26 19:37:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-446616402 => generated 98 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 26 19:37:04.784283 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d5ff7365-8a77-4c2c-89fd-7a1a96f40601 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013708 May 26 19:37:04.785654 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 14/33] 10.222.0.72 () {58 vars in 1139 bytes} [Thu May 26 19:37:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 19:37:04.798211 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-086d6eb4-2c25-4f15-93b9-bfdad6f2c3a9 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007782 May 26 19:37:04.799318 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 15/34] 10.222.0.72 () {58 vars in 1136 bytes} [Thu May 26 19:37:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 19:37:04.809605 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9bd63423-c2f7-4df9-9cfc-a585969701f4 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa7886ef1f0>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:04.882015 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6b224591-1c0e-4896-8ac1-92b89199da93 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.244512 May 26 19:37:04.882884 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 20/35] 10.222.0.72 () {58 vars in 1148 bytes} [Thu May 26 19:37:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:04.892221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-64cd3106-726f-40bd-98c9-7292e389fd8b tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Calling method '.version_select at 0x7fa7898cfd30>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:04.947537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-9bd63423-c2f7-4df9-9cfc-a585969701f4 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] HTTP exception thrown: Snapshot 7bed2c34-ee5b-458c-8535-a439398002ef could not be found. May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9bd63423-c2f7-4df9-9cfc-a585969701f4 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Request method failure captured: May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef HTTP/1.1 May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bVT9rLRLuIzZherwUy0jMsoii79dnUhrAzLq57eX4urk1Xbhe6LurL23Ltej20WGncwb3qbs91J3LFC0DZyGD5HxAiA7gn7bul0uswKR9Zksjna2naZavGnzYO2RTcZ2qvlMBheGkuzL23wCOE1hQfeDsz2K958h-dwvWjqOHf1w8 May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 12fd2c61d24049d0bc840aad1ed896ba May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:37:04.956069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_12fd2c61d24049d0bc840aad1ed896ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 12fd2c61d24049d0bc840aad1ed896ba May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesSnapshotsTestJSON-439990681-project May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: ae1d9e27067f4cc9afc5e6a97d47cace May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-439990681-project May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Snapshot 7bed2c34-ee5b-458c-8535-a439398002ef could not be found. May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '7bed2c34-ee5b-458c-8535-a439398002ef'} May 26 19:37:04.957345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7bed2c34-ee5b-458c-8535-a439398002ef could not be found. (HTTP 404) (Request-ID: req-f3dac855-3fb3-4fb3-9de7-ce6d7fb4f724) May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.958137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:37:04.959791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7bed2c34-ee5b-458c-8535-a439398002ef could not be found. May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 19:37:04.960913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7bed2c34-ee5b-458c-8535-a439398002ef could not be found. May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7bed2c34-ee5b-458c-8535-a439398002ef could not be found. May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9bd63423-c2f7-4df9-9cfc-a585969701f4 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Returning 404 to user: Snapshot 7bed2c34-ee5b-458c-8535-a439398002ef could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:04.962170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9bd63423-c2f7-4df9-9cfc-a585969701f4 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef" status: 404 len: 111 microversion: 2.1 time: 0.158643 May 26 19:37:04.962980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 16/36] 10.222.0.72 () {58 vars in 1250 bytes} [Thu May 26 19:37:04 2022] GET /compute/v2.1/os-snapshots/7bed2c34-ee5b-458c-8535-a439398002ef => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:37:04.985587 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c903229b-ec67-4509-b0a7-15b7d5429831 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa788766f70>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:05.034121 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-64cd3106-726f-40bd-98c9-7292e389fd8b tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] HTTP exception thrown: Volume e2b3c270-d038-41e6-a78a-8cbb0522ee50 could not be found. May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-64cd3106-726f-40bd-98c9-7292e389fd8b tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Request method failure captured: May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/os-volumes/e2b3c270-d038-41e6-a78a-8cbb0522ee50 HTTP/1.1 May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bgat3c7zscFOivnJj_u5bVpcy_VEI8P_UbupUkogQ9b--mIZK4UGc1IeiFTvPOyLCpqMD1vb2DAyGvVAapOueXynz15iPpngN6_sJyGiuIbv6XT4mo2pB6lQtNzq9cy1Rigc5_hV-tbenmKbnC9dr6FYNpYDVtxIpnd6BatBsNyVY May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:37:05.040282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1bce8858c2aa453fb5d1fa3fb92f5a9c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-VolumesNegativeTest-1982752572 May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: d31f924fba7c4a7aa23acc1712e0d487 May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Volume e2b3c270-d038-41e6-a78a-8cbb0522ee50 could not be found. May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': 'e2b3c270-d038-41e6-a78a-8cbb0522ee50'} May 26 19:37:05.041362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2b3c270-d038-41e6-a78a-8cbb0522ee50 could not be found. (HTTP 404) (Request-ID: req-ff753be8-1156-4b10-a999-ef790bb53ecf) May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:05.041975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 19:37:05.042828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2b3c270-d038-41e6-a78a-8cbb0522ee50 could not be found. May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 19:37:05.045014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2b3c270-d038-41e6-a78a-8cbb0522ee50 could not be found. May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2b3c270-d038-41e6-a78a-8cbb0522ee50 could not be found. May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-64cd3106-726f-40bd-98c9-7292e389fd8b tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Returning 404 to user: Volume e2b3c270-d038-41e6-a78a-8cbb0522ee50 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-64cd3106-726f-40bd-98c9-7292e389fd8b tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/e2b3c270-d038-41e6-a78a-8cbb0522ee50" status: 404 len: 109 microversion: 2.1 time: 0.157830 May 26 19:37:05.046637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 21/37] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:37:04 2022] DELETE /compute/v2.1/os-volumes/e2b3c270-d038-41e6-a78a-8cbb0522ee50 => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:37:05.066320 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-833ea93f-1841-482e-b5db-097847acbb01 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:05.070337 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-833ea93f-1841-482e-b5db-097847acbb01 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:05.117463 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-833ea93f-1841-482e-b5db-097847acbb01 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:05.123008 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-833ea93f-1841-482e-b5db-097847acbb01 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:05.123995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-833ea93f-1841-482e-b5db-097847acbb01 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:05.128333 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-833ea93f-1841-482e-b5db-097847acbb01 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:05.288403 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c903229b-ec67-4509-b0a7-15b7d5429831 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.324341 May 26 19:37:05.290631 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 17/38] 10.222.0.72 () {58 vars in 1133 bytes} [Thu May 26 19:37:04 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:05.297931 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-726622af-5a90-4434-bd04-080e73c19434 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa7887b8280>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:05.531696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-726622af-5a90-4434-bd04-080e73c19434 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f" status: 202 len: 0 microversion: 2.1 time: 0.239077 May 26 19:37:05.532774 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 18/39] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:37:05 2022] DELETE /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:37:05.541966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7a963b8b-8afc-4b9f-b89f-92048ca63cc9 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Calling method '.version_select at 0x7fa7886ef430>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:05.621875 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-7a963b8b-8afc-4b9f-b89f-92048ca63cc9 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] HTTP exception thrown: Volume 225d1d02-18b1-40cf-8838-0b0a89209060 could not be found. May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7a963b8b-8afc-4b9f-b89f-92048ca63cc9 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Request method failure captured: May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/os-volumes/225d1d02-18b1-40cf-8838-0b0a89209060 HTTP/1.1 May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bgat3c7zscFOivnJj_u5bVpcy_VEI8P_UbupUkogQ9b--mIZK4UGc1IeiFTvPOyLCpqMD1vb2DAyGvVAapOueXynz15iPpngN6_sJyGiuIbv6XT4mo2pB6lQtNzq9cy1Rigc5_hV-tbenmKbnC9dr6FYNpYDVtxIpnd6BatBsNyVY May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:37:05.624756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1bce8858c2aa453fb5d1fa3fb92f5a9c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1bce8858c2aa453fb5d1fa3fb92f5a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesNegativeTest-1982752572 May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 1bce8858c2aa453fb5d1fa3fb92f5a9c May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesNegativeTest-1982752572 May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: d31f924fba7c4a7aa23acc1712e0d487 May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesNegativeTest-1982752572-project May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Volume 225d1d02-18b1-40cf-8838-0b0a89209060 could not be found. May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '225d1d02-18b1-40cf-8838-0b0a89209060'} May 26 19:37:05.626063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 225d1d02-18b1-40cf-8838-0b0a89209060 could not be found. (HTTP 404) (Request-ID: req-a73f0cc2-481d-49a9-9313-6f11ca01549c) May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:05.626817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:37:05.627889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 225d1d02-18b1-40cf-8838-0b0a89209060 could not be found. May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 19:37:05.629012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 225d1d02-18b1-40cf-8838-0b0a89209060 could not be found. May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 225d1d02-18b1-40cf-8838-0b0a89209060 could not be found. May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7a963b8b-8afc-4b9f-b89f-92048ca63cc9 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] Returning 404 to user: Volume 225d1d02-18b1-40cf-8838-0b0a89209060 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7a963b8b-8afc-4b9f-b89f-92048ca63cc9 tempest-VolumesNegativeTest-1982752572 tempest-VolumesNegativeTest-1982752572-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/225d1d02-18b1-40cf-8838-0b0a89209060" status: 404 len: 109 microversion: 2.1 time: 0.092307 May 26 19:37:05.630126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 19/40] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:37:05 2022] GET /compute/v2.1/os-volumes/225d1d02-18b1-40cf-8838-0b0a89209060 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:37:05.648336 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4da18b18-0db7-46be-9cc8-b9ee2b191cab tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa78879d4c0>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:05.900436 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4da18b18-0db7-46be-9cc8-b9ee2b191cab tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.272142 May 26 19:37:05.901571 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 20/41] 10.222.0.72 () {58 vars in 1166 bytes} [Thu May 26 19:37:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:05.907781 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d2a77727-2225-4250-933c-6b70e8eb7478 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa788753160>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:05.995700 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d2a77727-2225-4250-933c-6b70e8eb7478 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f" status: 200 len: 345 microversion: 2.1 time: 0.092029 May 26 19:37:05.996941 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 21/42] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:37:05 2022] GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:06.007903 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c0290a62-979a-4e28-a57b-eb206fb07c93 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa7886da4c0>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:06.147643 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c0290a62-979a-4e28-a57b-eb206fb07c93 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.144034 May 26 19:37:06.148542 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 22/43] 10.222.0.72 () {58 vars in 1169 bytes} [Thu May 26 19:37:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:06.162194 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bb843593-d614-489b-b184-4225c58917a2 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa78870cc10>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:06.191420 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-833ea93f-1841-482e-b5db-097847acbb01 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:06.281713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bb843593-d614-489b-b184-4225c58917a2 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.125097 May 26 19:37:06.282390 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 23/44] 10.222.0.72 () {58 vars in 1154 bytes} [Thu May 26 19:37:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:06.286151 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-833ea93f-1841-482e-b5db-097847acbb01 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1272 microversion: 2.1 time: 1.227198 May 26 19:37:06.286919 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 22/45] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:05 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1272 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:06.314386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e8fd12ee-043e-4735-a09e-91ea359bf11b tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa7886fde50>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:06.512892 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e8fd12ee-043e-4735-a09e-91ea359bf11b tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.205972 May 26 19:37:06.513745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 24/46] 10.222.0.72 () {58 vars in 1187 bytes} [Thu May 26 19:37:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:06.542073 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f28cb431-b48e-4da7-ac56-c4b0d08614d1 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] Calling method '.version_select at 0x7fa788fd3d30>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:06.658583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f28cb431-b48e-4da7-ac56-c4b0d08614d1 tempest-VolumesTestJSON-225426915 tempest-VolumesTestJSON-225426915-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.135662 May 26 19:37:06.660726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 23/47] 10.222.0.72 () {58 vars in 1154 bytes} [Thu May 26 19:37:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:07.019557 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-04ce82f8-2091-4c62-94a1-8528189c419a tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa7886dab80>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:07.309088 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-aeb4f0ab-54fe-4e62-b017-28434bd6af46 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:07.310491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-aeb4f0ab-54fe-4e62-b017-28434bd6af46 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:07.345398 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aeb4f0ab-54fe-4e62-b017-28434bd6af46 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:07.347701 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aeb4f0ab-54fe-4e62-b017-28434bd6af46 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:07.354577 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aeb4f0ab-54fe-4e62-b017-28434bd6af46 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:07.359927 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aeb4f0ab-54fe-4e62-b017-28434bd6af46 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:07.371582 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-04ce82f8-2091-4c62-94a1-8528189c419a tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] HTTP exception thrown: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-04ce82f8-2091-4c62-94a1-8528189c419a tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Request method failure captured: May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f HTTP/1.1 May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bVT9rLRLuIzZherwUy0jMsoii79dnUhrAzLq57eX4urk1Xbhe6LurL23Ltej20WGncwb3qbs91J3LFC0DZyGD5HxAiA7gn7bul0uswKR9Zksjna2naZavGnzYO2RTcZ2qvlMBheGkuzL23wCOE1hQfeDsz2K958h-dwvWjqOHf1w8 May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 12fd2c61d24049d0bc840aad1ed896ba May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:37:07.373635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_12fd2c61d24049d0bc840aad1ed896ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 12fd2c61d24049d0bc840aad1ed896ba May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesSnapshotsTestJSON-439990681-project May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: ae1d9e27067f4cc9afc5e6a97d47cace May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-439990681-project May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'f043a01b-d751-4f95-b7de-b0b918a85f4f'} May 26 19:37:07.374762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. (HTTP 404) (Request-ID: req-00defc6b-9d87-495b-b428-4c035ef40635) May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:07.375463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:37:07.376357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 19:37:07.377254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-04ce82f8-2091-4c62-94a1-8528189c419a tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Returning 404 to user: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:07.378134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-04ce82f8-2091-4c62-94a1-8528189c419a tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f" status: 404 len: 109 microversion: 2.1 time: 0.369525 May 26 19:37:07.378996 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 25/48] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:37:07 2022] GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f => generated 109 bytes in 373 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:37:07.410327 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c441d26e-0e0b-4655-935d-c27aee1a9dd5 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa7886da700>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:07.496969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-c441d26e-0e0b-4655-935d-c27aee1a9dd5 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] HTTP exception thrown: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c441d26e-0e0b-4655-935d-c27aee1a9dd5 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Request method failure captured: May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: DELETE /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f HTTP/1.1 May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bVT9rLRLuIzZherwUy0jMsoii79dnUhrAzLq57eX4urk1Xbhe6LurL23Ltej20WGncwb3qbs91J3LFC0DZyGD5HxAiA7gn7bul0uswKR9Zksjna2naZavGnzYO2RTcZ2qvlMBheGkuzL23wCOE1hQfeDsz2K958h-dwvWjqOHf1w8 May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 12fd2c61d24049d0bc840aad1ed896ba May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:37:07.499215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_12fd2c61d24049d0bc840aad1ed896ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 12fd2c61d24049d0bc840aad1ed896ba May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesSnapshotsTestJSON-439990681-project May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: ae1d9e27067f4cc9afc5e6a97d47cace May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-439990681-project May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'f043a01b-d751-4f95-b7de-b0b918a85f4f'} May 26 19:37:07.500333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. (HTTP 404) (Request-ID: req-b877a91d-48ea-43b8-94b2-c1f0d901fb36) May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:07.500987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 19:37:07.502011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 19:37:07.502961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.503871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.507705 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c441d26e-0e0b-4655-935d-c27aee1a9dd5 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Returning 404 to user: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:07.508852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c441d26e-0e0b-4655-935d-c27aee1a9dd5 tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f" status: 404 len: 109 microversion: 2.1 time: 0.109901 May 26 19:37:07.509915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 26/49] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:37:07 2022] DELETE /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:37:07.525482 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ab3f64c8-8e2a-4db5-b30d-238f394a65bd tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Calling method '.version_select at 0x7fa78870c4c0>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:07.608554 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-ab3f64c8-8e2a-4db5-b30d-238f394a65bd tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] HTTP exception thrown: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ab3f64c8-8e2a-4db5-b30d-238f394a65bd tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Request method failure captured: May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f HTTP/1.1 May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bVT9rLRLuIzZherwUy0jMsoii79dnUhrAzLq57eX4urk1Xbhe6LurL23Ltej20WGncwb3qbs91J3LFC0DZyGD5HxAiA7gn7bul0uswKR9Zksjna2naZavGnzYO2RTcZ2qvlMBheGkuzL23wCOE1hQfeDsz2K958h-dwvWjqOHf1w8 May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 12fd2c61d24049d0bc840aad1ed896ba May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:37:07.613152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_12fd2c61d24049d0bc840aad1ed896ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/12fd2c61d24049d0bc840aad1ed896ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 12fd2c61d24049d0bc840aad1ed896ba May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-439990681 May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesSnapshotsTestJSON-439990681-project May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: ae1d9e27067f4cc9afc5e6a97d47cace May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-439990681-project May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'f043a01b-d751-4f95-b7de-b0b918a85f4f'} May 26 19:37:07.614256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. (HTTP 404) (Request-ID: req-25027e7b-09b8-4ddb-b65e-b4f513baf767) May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:07.615546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 19:37:07.616452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 19:37:07.617387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. May 26 19:37:07.618529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:37:07.624276 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ab3f64c8-8e2a-4db5-b30d-238f394a65bd tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] Returning 404 to user: Volume f043a01b-d751-4f95-b7de-b0b918a85f4f could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:37:07.626844 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ab3f64c8-8e2a-4db5-b30d-238f394a65bd tempest-VolumesSnapshotsTestJSON-439990681 tempest-VolumesSnapshotsTestJSON-439990681-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f" status: 404 len: 109 microversion: 2.1 time: 0.112098 May 26 19:37:07.627846 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 27/50] 10.222.0.72 () {58 vars in 1244 bytes} [Thu May 26 19:37:07 2022] GET /compute/v2.1/os-volumes/f043a01b-d751-4f95-b7de-b0b918a85f4f => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:37:08.004030 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-aeb4f0ab-54fe-4e62-b017-28434bd6af46 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:08.004030 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-aeb4f0ab-54fe-4e62-b017-28434bd6af46 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1272 microversion: 2.1 time: 0.629066 May 26 19:37:08.004030 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 24/51] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:07 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1272 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:08.934682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:08.951647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-73d8cf8e-01e1-4172-8c33-6843c663104b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:08.952277 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-73d8cf8e-01e1-4172-8c33-6843c663104b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:08.962109 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-73d8cf8e-01e1-4172-8c33-6843c663104b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:08.968384 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-73d8cf8e-01e1-4172-8c33-6843c663104b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:08.970353 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-73d8cf8e-01e1-4172-8c33-6843c663104b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:08.970812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-73d8cf8e-01e1-4172-8c33-6843c663104b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:09.579661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-130272789", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:09.694812 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] validate_networks() for [('de8e5bc4-ae32-4144-a7c5-8bfa7df1b65d', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:37:09.824953 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-73d8cf8e-01e1-4172-8c33-6843c663104b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:09.839384 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-73d8cf8e-01e1-4172-8c33-6843c663104b tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.886611 May 26 19:37:09.840268 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 25/52] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:08 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:10.862872 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a19ac088-05ee-46e7-a0d8-6de3d9c2c6e1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:10.866968 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a19ac088-05ee-46e7-a0d8-6de3d9c2c6e1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:10.878511 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a19ac088-05ee-46e7-a0d8-6de3d9c2c6e1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:10.881477 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a19ac088-05ee-46e7-a0d8-6de3d9c2c6e1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:10.884788 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a19ac088-05ee-46e7-a0d8-6de3d9c2c6e1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:10.885284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a19ac088-05ee-46e7-a0d8-6de3d9c2c6e1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:10.962429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:37:10.963641 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:37:10.964302 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:37:10.965021 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:37:10.965582 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:37:10.991124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:10.991124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:10.991124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:10.991124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:11.070287 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Getting quotas for project bf99d88fec9046608e464a5e2c75506e. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:37:11.084664 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Getting quotas for user 9a0e96324450438699abfcefec6d1a6d and project bf99d88fec9046608e464a5e2c75506e. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:37:11.131826 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:37:11.135869 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:37:11.467752 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a19ac088-05ee-46e7-a0d8-6de3d9c2c6e1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:11.478021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a19ac088-05ee-46e7-a0d8-6de3d9c2c6e1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.623531 May 26 19:37:11.482053 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 26/53] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:10 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:11.488767 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1496822509", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ddf1778-5518-469d-acdc-1047098dc517"}], "security_groups": [{"name": "tempest-securitygroup--1527233912"}], "key_name": "tempest-keypair-437929174", "user_data": "}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:11.489145 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-35350720-82e2-4bce-bd56-e471a8bf37bb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.568270 May 26 19:37:11.496224 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 28/54] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:37:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:37:11.502401 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-85c5c248-40cc-459d-b0db-b5c39e9a985d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:11.503378 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-85c5c248-40cc-459d-b0db-b5c39e9a985d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:11.674510 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-85c5c248-40cc-459d-b0db-b5c39e9a985d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:11.723404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-85c5c248-40cc-459d-b0db-b5c39e9a985d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1221 microversion: 2.1 time: 0.218071 May 26 19:37:11.725401 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 29/55] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:11 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1221 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:11.967983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] validate_networks() for [('2ddf1778-5518-469d-acdc-1047098dc517', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:37:12.302319 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-212875524", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:12.436162 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] validate_networks() for [('de8e5bc4-ae32-4144-a7c5-8bfa7df1b65d', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:37:12.556828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=4 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:13.693919 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:37:13.695056 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:37:13.695880 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:37:13.696466 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:37:13.697092 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:37:13.710303 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:13.711322 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:13.714663 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:13.715798 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:13.786143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Getting quotas for project bf99d88fec9046608e464a5e2c75506e. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:37:13.801552 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Getting quotas for user 9a0e96324450438699abfcefec6d1a6d and project bf99d88fec9046608e464a5e2c75506e. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:37:13.845203 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:37:13.851429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:37:14.109187 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1c1edf37-9fa5-4099-bc76-e479ef0af66c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.810908 May 26 19:37:14.109836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 30/56] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:37:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 19:37:14.141679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-17f206d1-7ea9-4236-b08f-dcdbce10ed24 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:14.142383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-17f206d1-7ea9-4236-b08f-dcdbce10ed24 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:14.166158 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-17f206d1-7ea9-4236-b08f-dcdbce10ed24 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:14.168797 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-17f206d1-7ea9-4236-b08f-dcdbce10ed24 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:14.172516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-17f206d1-7ea9-4236-b08f-dcdbce10ed24 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:14.172902 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-17f206d1-7ea9-4236-b08f-dcdbce10ed24 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:14.625513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-17f206d1-7ea9-4236-b08f-dcdbce10ed24 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:14.637458 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-17f206d1-7ea9-4236-b08f-dcdbce10ed24 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.512817 May 26 19:37:14.642894 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 31/57] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:14 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:14.652215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ccf850f7-8d0c-400e-a9c9-f7bbeaba12ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:14.653088 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ccf850f7-8d0c-400e-a9c9-f7bbeaba12ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:14.793212 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ccf850f7-8d0c-400e-a9c9-f7bbeaba12ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:14.804227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ccf850f7-8d0c-400e-a9c9-f7bbeaba12ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1221 microversion: 2.1 time: 0.154851 May 26 19:37:14.804836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 32/58] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:14 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1221 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:15.519018 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:37:15.519462 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:37:15.519929 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:37:15.520416 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:37:15.520797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:37:15.545545 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-44d6d0ed-846d-4803-a1ce-c0ee3563d7f3 req-48cdb343-dbc5-4d1b-9246-5e3bfad52909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26f44b8-4d34-4dde-8e5a-e369b12b8ab1", "tag": "603ce21e-f566-48c7-964e-f1beb677bcda"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:15.550305 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:15.550757 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:15.562175 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:15.564847 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:15.585299 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-44d6d0ed-846d-4803-a1ce-c0ee3563d7f3 req-48cdb343-dbc5-4d1b-9246-5e3bfad52909 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:15.585299 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-44d6d0ed-846d-4803-a1ce-c0ee3563d7f3 req-48cdb343-dbc5-4d1b-9246-5e3bfad52909 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:15.676539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-44d6d0ed-846d-4803-a1ce-c0ee3563d7f3 req-48cdb343-dbc5-4d1b-9246-5e3bfad52909 service nova] Creating event network-changed:603ce21e-f566-48c7-964e-f1beb677bcda for instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 on hv-cinder-82549 May 26 19:37:15.679944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-44d6d0ed-846d-4803-a1ce-c0ee3563d7f3 req-48cdb343-dbc5-4d1b-9246-5e3bfad52909 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 19:37:15.685119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ac06a8c-9c18-453e-9b62-6e226ba34439 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:15.685875 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ac06a8c-9c18-453e-9b62-6e226ba34439 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:15.687917 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ac06a8c-9c18-453e-9b62-6e226ba34439 None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:15.692720 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ac06a8c-9c18-453e-9b62-6e226ba34439 None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:15.696539 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:37:15.714820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.compute.rpcapi [None req-4ac06a8c-9c18-453e-9b62-6e226ba34439 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 19:37:15.720140 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ac06a8c-9c18-453e-9b62-6e226ba34439 None None] Releasing lock "compute-rpcapi-router" {{(pid=124877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 19:37:15.725065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for user 841abe37b81f47d2a95140e46b12ea08 and project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:37:15.783366 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:37:15.787996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:37:15.789602 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4ac06a8c-9c18-453e-9b62-6e226ba34439 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.803174 May 26 19:37:15.790674 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 33/59] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:15.797298 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bd2dbc07-9d5b-4a4f-81bb-a6b5192f67bd tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:15.798884 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bd2dbc07-9d5b-4a4f-81bb-a6b5192f67bd tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:15.811196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bd2dbc07-9d5b-4a4f-81bb-a6b5192f67bd tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:15.811872 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bd2dbc07-9d5b-4a4f-81bb-a6b5192f67bd tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:15.812803 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bd2dbc07-9d5b-4a4f-81bb-a6b5192f67bd tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:15.813949 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bd2dbc07-9d5b-4a4f-81bb-a6b5192f67bd tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:16.051734 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c62b405d-52bf-4a3b-bbc5-91cc82cb054c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.568176 May 26 19:37:16.057771 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 27/60] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:37:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 4570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:37:16.067872 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d5b305b8-3fcf-4951-b641-0df6447d4e9a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:16.068560 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d5b305b8-3fcf-4951-b641-0df6447d4e9a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:16.085660 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d5b305b8-3fcf-4951-b641-0df6447d4e9a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:16.086111 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d5b305b8-3fcf-4951-b641-0df6447d4e9a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:16.088226 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d5b305b8-3fcf-4951-b641-0df6447d4e9a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:16.089081 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d5b305b8-3fcf-4951-b641-0df6447d4e9a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:16.250232 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-bd2dbc07-9d5b-4a4f-81bb-a6b5192f67bd tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:16.262127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bd2dbc07-9d5b-4a4f-81bb-a6b5192f67bd tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.470044 May 26 19:37:16.265748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 34/61] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:15 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:16.266890 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d5b305b8-3fcf-4951-b641-0df6447d4e9a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:16.277659 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d5b305b8-3fcf-4951-b641-0df6447d4e9a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1225 microversion: 2.1 time: 0.223063 May 26 19:37:16.279081 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7896959f-4cd1-4306-a602-e70c25072357 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:16.280451 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7896959f-4cd1-4306-a602-e70c25072357 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:16.283000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 28/62] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:16 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1225 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:16.462029 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7896959f-4cd1-4306-a602-e70c25072357 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:16.507565 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7896959f-4cd1-4306-a602-e70c25072357 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1241 microversion: 2.1 time: 0.240405 May 26 19:37:16.517553 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 35/63] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:16 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1241 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:17.288379 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-10e24313-6aab-4d66-85d9-cead61335289 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:17.289606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-10e24313-6aab-4d66-85d9-cead61335289 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:17.301596 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1741cbe9-d0e0-4c01-9b63-a1411e43a714 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:17.303446 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1741cbe9-d0e0-4c01-9b63-a1411e43a714 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:17.310671 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-10e24313-6aab-4d66-85d9-cead61335289 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:17.311370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-10e24313-6aab-4d66-85d9-cead61335289 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:17.313308 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1741cbe9-d0e0-4c01-9b63-a1411e43a714 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:17.313895 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-10e24313-6aab-4d66-85d9-cead61335289 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:17.314214 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1741cbe9-d0e0-4c01-9b63-a1411e43a714 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:17.314370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-10e24313-6aab-4d66-85d9-cead61335289 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:17.315787 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1741cbe9-d0e0-4c01-9b63-a1411e43a714 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:17.316919 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1741cbe9-d0e0-4c01-9b63-a1411e43a714 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:17.505810 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1741cbe9-d0e0-4c01-9b63-a1411e43a714 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:17.509937 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1741cbe9-d0e0-4c01-9b63-a1411e43a714 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1273 microversion: 2.1 time: 0.212071 May 26 19:37:17.510534 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 36/64] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:17 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:17.539252 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e3bac16c-5ddc-4d84-9e86-98a09dc75a5f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:17.539870 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e3bac16c-5ddc-4d84-9e86-98a09dc75a5f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:17.747249 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e3bac16c-5ddc-4d84-9e86-98a09dc75a5f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:17.758833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e3bac16c-5ddc-4d84-9e86-98a09dc75a5f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1241 microversion: 2.1 time: 0.228251 May 26 19:37:17.759920 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 37/65] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:17 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1241 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:17.900496 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-10e24313-6aab-4d66-85d9-cead61335289 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:17.908675 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-10e24313-6aab-4d66-85d9-cead61335289 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.624395 May 26 19:37:17.912818 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 29/66] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:17 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:18.544235 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fe3b7af6-8e6e-4f16-9ef0-dbd9bb596872 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:18.545932 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fe3b7af6-8e6e-4f16-9ef0-dbd9bb596872 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:18.562484 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fe3b7af6-8e6e-4f16-9ef0-dbd9bb596872 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:18.564792 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fe3b7af6-8e6e-4f16-9ef0-dbd9bb596872 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:18.567599 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fe3b7af6-8e6e-4f16-9ef0-dbd9bb596872 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:18.567599 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fe3b7af6-8e6e-4f16-9ef0-dbd9bb596872 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:18.777035 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8633e9d3-9c62-495f-8f00-6cbbf9ffb4d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:18.777688 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8633e9d3-9c62-495f-8f00-6cbbf9ffb4d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:18.794046 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8633e9d3-9c62-495f-8f00-6cbbf9ffb4d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:18.794046 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8633e9d3-9c62-495f-8f00-6cbbf9ffb4d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:18.803213 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8633e9d3-9c62-495f-8f00-6cbbf9ffb4d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:18.812381 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8633e9d3-9c62-495f-8f00-6cbbf9ffb4d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:18.878771 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fe3b7af6-8e6e-4f16-9ef0-dbd9bb596872 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:18.901200 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fe3b7af6-8e6e-4f16-9ef0-dbd9bb596872 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1279 microversion: 2.1 time: 0.362833 May 26 19:37:18.920445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 38/67] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:18 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1279 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:18.932287 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b46e1a81-4959-4114-804c-7e7eaa632402 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:18.932287 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b46e1a81-4959-4114-804c-7e7eaa632402 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:18.951316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b46e1a81-4959-4114-804c-7e7eaa632402 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:18.955271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b46e1a81-4959-4114-804c-7e7eaa632402 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:18.956377 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b46e1a81-4959-4114-804c-7e7eaa632402 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:18.957518 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b46e1a81-4959-4114-804c-7e7eaa632402 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:18.979336 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8633e9d3-9c62-495f-8f00-6cbbf9ffb4d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:18.989642 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8633e9d3-9c62-495f-8f00-6cbbf9ffb4d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1237 microversion: 2.1 time: 0.216511 May 26 19:37:18.999751 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 30/68] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:18 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1237 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:19.220271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b46e1a81-4959-4114-804c-7e7eaa632402 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:19.230866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b46e1a81-4959-4114-804c-7e7eaa632402 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.305921 May 26 19:37:19.231511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 39/69] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:18 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:19.938014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0ef1ec03-77b1-465b-ba81-7fe7e3ee3f56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:19.939420 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0ef1ec03-77b1-465b-ba81-7fe7e3ee3f56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:19.951740 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0ef1ec03-77b1-465b-ba81-7fe7e3ee3f56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:19.952484 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0ef1ec03-77b1-465b-ba81-7fe7e3ee3f56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:19.955336 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0ef1ec03-77b1-465b-ba81-7fe7e3ee3f56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:19.955965 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0ef1ec03-77b1-465b-ba81-7fe7e3ee3f56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:20.009268 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7151bab7-e4e0-4f22-8d0a-74149814ba1e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:20.010558 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7151bab7-e4e0-4f22-8d0a-74149814ba1e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:20.043555 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7151bab7-e4e0-4f22-8d0a-74149814ba1e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:20.046598 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7151bab7-e4e0-4f22-8d0a-74149814ba1e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:20.046598 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7151bab7-e4e0-4f22-8d0a-74149814ba1e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:20.046598 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7151bab7-e4e0-4f22-8d0a-74149814ba1e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:20.220885 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0ef1ec03-77b1-465b-ba81-7fe7e3ee3f56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:20.236989 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0ef1ec03-77b1-465b-ba81-7fe7e3ee3f56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1279 microversion: 2.1 time: 0.305730 May 26 19:37:20.252293 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 31/70] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:19 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1279 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:20.268516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-98381ff2-3462-417f-ae4c-ac25e21bb96c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:20.271280 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-98381ff2-3462-417f-ae4c-ac25e21bb96c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:20.283185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-98381ff2-3462-417f-ae4c-ac25e21bb96c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:20.283721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-98381ff2-3462-417f-ae4c-ac25e21bb96c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:20.290379 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-98381ff2-3462-417f-ae4c-ac25e21bb96c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:20.290978 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-98381ff2-3462-417f-ae4c-ac25e21bb96c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:20.534093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7151bab7-e4e0-4f22-8d0a-74149814ba1e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:20.549357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7151bab7-e4e0-4f22-8d0a-74149814ba1e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1301 microversion: 2.1 time: 0.543502 May 26 19:37:20.551779 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 40/71] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:20 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1301 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:20.670305 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-98381ff2-3462-417f-ae4c-ac25e21bb96c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:20.681382 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-98381ff2-3462-417f-ae4c-ac25e21bb96c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.427217 May 26 19:37:20.681969 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 32/72] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:20 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:21.272642 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-09617dcc-ef9a-4a73-b485-7de7143bbb33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:21.274037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-09617dcc-ef9a-4a73-b485-7de7143bbb33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:21.282554 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-09617dcc-ef9a-4a73-b485-7de7143bbb33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:21.283325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-09617dcc-ef9a-4a73-b485-7de7143bbb33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:21.284461 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-09617dcc-ef9a-4a73-b485-7de7143bbb33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:21.285196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-09617dcc-ef9a-4a73-b485-7de7143bbb33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:21.569217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e552e194-e4b9-42db-a92e-8d9abced09b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:21.569832 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e552e194-e4b9-42db-a92e-8d9abced09b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:21.587295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e552e194-e4b9-42db-a92e-8d9abced09b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:21.588027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e552e194-e4b9-42db-a92e-8d9abced09b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:21.589134 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e552e194-e4b9-42db-a92e-8d9abced09b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:21.590069 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e552e194-e4b9-42db-a92e-8d9abced09b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:21.776763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e552e194-e4b9-42db-a92e-8d9abced09b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:21.776763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e552e194-e4b9-42db-a92e-8d9abced09b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1299 microversion: 2.1 time: 0.165401 May 26 19:37:21.776763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 33/73] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:21 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1299 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:21.776763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4a638c49-8b24-4428-a092-a7d820b144fb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:21.777747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4a638c49-8b24-4428-a092-a7d820b144fb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:21.777747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a638c49-8b24-4428-a092-a7d820b144fb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:21.777747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a638c49-8b24-4428-a092-a7d820b144fb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:21.777747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a638c49-8b24-4428-a092-a7d820b144fb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:21.778040 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a638c49-8b24-4428-a092-a7d820b144fb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:21.819525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-09617dcc-ef9a-4a73-b485-7de7143bbb33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:21.830225 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-09617dcc-ef9a-4a73-b485-7de7143bbb33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.562574 May 26 19:37:21.839980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 41/74] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:21 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:21.977510 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4a638c49-8b24-4428-a092-a7d820b144fb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:21.986706 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4a638c49-8b24-4428-a092-a7d820b144fb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.254838 May 26 19:37:21.999539 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 34/75] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:21 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:22.770283 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a1045dea-1339-45e7-bae9-ec10f4dfcd49 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:22.775849 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a1045dea-1339-45e7-bae9-ec10f4dfcd49 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:22.781533 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1045dea-1339-45e7-bae9-ec10f4dfcd49 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:22.792963 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1045dea-1339-45e7-bae9-ec10f4dfcd49 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:22.796947 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1045dea-1339-45e7-bae9-ec10f4dfcd49 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:22.797797 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1045dea-1339-45e7-bae9-ec10f4dfcd49 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:22.848591 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c3a30b68-9851-4ce9-ab90-25565ca9c45e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:22.849203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c3a30b68-9851-4ce9-ab90-25565ca9c45e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:22.859691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3a30b68-9851-4ce9-ab90-25565ca9c45e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:22.860871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3a30b68-9851-4ce9-ab90-25565ca9c45e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:22.867915 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3a30b68-9851-4ce9-ab90-25565ca9c45e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:22.868708 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3a30b68-9851-4ce9-ab90-25565ca9c45e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:23.181758 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c3a30b68-9851-4ce9-ab90-25565ca9c45e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:23.199828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c3a30b68-9851-4ce9-ab90-25565ca9c45e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.351626 May 26 19:37:23.206315 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 35/76] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:22 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:23.214517 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0fb847b1-11ef-4b5a-893e-65e81b0961b0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:23.215445 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0fb847b1-11ef-4b5a-893e-65e81b0961b0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:23.234843 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0fb847b1-11ef-4b5a-893e-65e81b0961b0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:23.234843 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0fb847b1-11ef-4b5a-893e-65e81b0961b0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:23.236128 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0fb847b1-11ef-4b5a-893e-65e81b0961b0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:23.236772 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0fb847b1-11ef-4b5a-893e-65e81b0961b0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:23.383542 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a1045dea-1339-45e7-bae9-ec10f4dfcd49 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:23.397652 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=69 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:23.416238 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a1045dea-1339-45e7-bae9-ec10f4dfcd49 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.653716 May 26 19:37:23.432400 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 42/77] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:22 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:23.593587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0fb847b1-11ef-4b5a-893e-65e81b0961b0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:23.613755 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0fb847b1-11ef-4b5a-893e-65e81b0961b0 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.405702 May 26 19:37:23.615906 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 36/78] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:23 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:23.692394 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-d06212ae-3034-40db-a51e-e8d6d720aa11 req-e7fd5603-34bf-4d44-993e-afc05e21084e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe881d0-23c9-414a-a94b-8be8035792f4", "tag": "40dd7f56-37e3-4a52-a2d9-f04821553aa0"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:23.697271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:23.699460 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-d06212ae-3034-40db-a51e-e8d6d720aa11 req-e7fd5603-34bf-4d44-993e-afc05e21084e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:23.699905 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-d06212ae-3034-40db-a51e-e8d6d720aa11 req-e7fd5603-34bf-4d44-993e-afc05e21084e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:23.727411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-d06212ae-3034-40db-a51e-e8d6d720aa11 req-e7fd5603-34bf-4d44-993e-afc05e21084e service nova] Creating event network-changed:40dd7f56-37e3-4a52-a2d9-f04821553aa0 for instance ebe881d0-23c9-414a-a94b-8be8035792f4 on hv-cinder-82549 May 26 19:37:23.747477 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-d06212ae-3034-40db-a51e-e8d6d720aa11 req-e7fd5603-34bf-4d44-993e-afc05e21084e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282096 May 26 19:37:23.748714 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 43/79] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:37:24.064852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-3169c162-0a74-4073-b065-9fc32291a382 req-251dc2c0-a65f-40f3-98c6-2541891b1f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee8cee6-5c93-4631-a2c1-f371a167fe97", "tag": "bb441dd0-8885-4c02-8728-1c89ea5d6a61"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:24.086403 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:24.106027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-3169c162-0a74-4073-b065-9fc32291a382 req-251dc2c0-a65f-40f3-98c6-2541891b1f78 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:24.107629 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-3169c162-0a74-4073-b065-9fc32291a382 req-251dc2c0-a65f-40f3-98c6-2541891b1f78 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:24.137296 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-3169c162-0a74-4073-b065-9fc32291a382 req-251dc2c0-a65f-40f3-98c6-2541891b1f78 service nova] Creating event network-changed:bb441dd0-8885-4c02-8728-1c89ea5d6a61 for instance cee8cee6-5c93-4631-a2c1-f371a167fe97 on hv-cinder-82549 May 26 19:37:24.141964 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-3169c162-0a74-4073-b065-9fc32291a382 req-251dc2c0-a65f-40f3-98c6-2541891b1f78 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 19:37:24.145423 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-288901c4-c332-4c91-891e-d870ef29c8ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:24.145423 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-288901c4-c332-4c91-891e-d870ef29c8ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:24.145423 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-288901c4-c332-4c91-891e-d870ef29c8ac None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:24.146028 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-288901c4-c332-4c91-891e-d870ef29c8ac None None] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:24.157247 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.compute.rpcapi [None req-288901c4-c332-4c91-891e-d870ef29c8ac None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 19:37:24.158395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-288901c4-c332-4c91-891e-d870ef29c8ac None None] Releasing lock "compute-rpcapi-router" {{(pid=124876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 19:37:24.188178 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-288901c4-c332-4c91-891e-d870ef29c8ac None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131315 May 26 19:37:24.190124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 37/80] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:24.216965 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d51582f7-c163-46d2-b082-44e88dc9017d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:24.217671 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d51582f7-c163-46d2-b082-44e88dc9017d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:24.226550 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d51582f7-c163-46d2-b082-44e88dc9017d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:24.227025 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d51582f7-c163-46d2-b082-44e88dc9017d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:24.227796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d51582f7-c163-46d2-b082-44e88dc9017d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:24.228392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d51582f7-c163-46d2-b082-44e88dc9017d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:24.438028 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-bae5d8b2-100e-4c95-823e-f9bfc3ab6d41 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:24.442741 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-bae5d8b2-100e-4c95-823e-f9bfc3ab6d41 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:24.457597 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bae5d8b2-100e-4c95-823e-f9bfc3ab6d41 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:24.458075 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bae5d8b2-100e-4c95-823e-f9bfc3ab6d41 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:24.458928 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bae5d8b2-100e-4c95-823e-f9bfc3ab6d41 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:24.459571 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bae5d8b2-100e-4c95-823e-f9bfc3ab6d41 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:24.708195 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-bae5d8b2-100e-4c95-823e-f9bfc3ab6d41 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:24.727284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-bae5d8b2-100e-4c95-823e-f9bfc3ab6d41 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.295379 May 26 19:37:24.728283 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 38/81] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:24 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:24.733515 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e4ebf264-0d01-43d1-b615-53cd401afae9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:24.735089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e4ebf264-0d01-43d1-b615-53cd401afae9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:24.742525 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4ebf264-0d01-43d1-b615-53cd401afae9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:24.743271 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4ebf264-0d01-43d1-b615-53cd401afae9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:24.744324 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4ebf264-0d01-43d1-b615-53cd401afae9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:24.745128 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4ebf264-0d01-43d1-b615-53cd401afae9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:24.754989 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d51582f7-c163-46d2-b082-44e88dc9017d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:24.764306 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d51582f7-c163-46d2-b082-44e88dc9017d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.555188 May 26 19:37:24.770867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 44/82] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:24 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:24.983396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e4ebf264-0d01-43d1-b615-53cd401afae9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:24.993368 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e4ebf264-0d01-43d1-b615-53cd401afae9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.263720 May 26 19:37:24.994806 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 39/83] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:24 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:25.743823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f3103fad-4c92-4670-9c93-b292a579071e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:25.744445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f3103fad-4c92-4670-9c93-b292a579071e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:25.746404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=6 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:25.752352 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f3103fad-4c92-4670-9c93-b292a579071e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:25.757199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f3103fad-4c92-4670-9c93-b292a579071e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:25.757199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f3103fad-4c92-4670-9c93-b292a579071e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:25.757199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f3103fad-4c92-4670-9c93-b292a579071e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:25.765842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-63aebef8-15f9-47bd-9945-d8440b2d5bf7 req-4653a643-d937-4ae6-8994-4a0fd039773d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdd25a5-210c-4638-95a5-4cf961b1d9d3", "tag": "4eedf65c-da1c-48d7-8869-d150a6c93ed0"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:25.787748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=6 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:25.800294 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-63aebef8-15f9-47bd-9945-d8440b2d5bf7 req-4653a643-d937-4ae6-8994-4a0fd039773d service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:25.801627 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-63aebef8-15f9-47bd-9945-d8440b2d5bf7 req-4653a643-d937-4ae6-8994-4a0fd039773d service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:25.821160 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-63aebef8-15f9-47bd-9945-d8440b2d5bf7 req-4653a643-d937-4ae6-8994-4a0fd039773d service nova] Creating event network-changed:4eedf65c-da1c-48d7-8869-d150a6c93ed0 for instance 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 on hv-cinder-82549 May 26 19:37:25.836564 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-63aebef8-15f9-47bd-9945-d8440b2d5bf7 req-4653a643-d937-4ae6-8994-4a0fd039773d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075738 May 26 19:37:25.838140 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 40/84] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:25.846225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d0cbca2e-5c00-49cd-990b-90f29f79342e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:25.847501 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d0cbca2e-5c00-49cd-990b-90f29f79342e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:25.855955 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d0cbca2e-5c00-49cd-990b-90f29f79342e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:25.856626 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d0cbca2e-5c00-49cd-990b-90f29f79342e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:25.857589 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d0cbca2e-5c00-49cd-990b-90f29f79342e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:25.858840 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d0cbca2e-5c00-49cd-990b-90f29f79342e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:25.863987 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=100 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:26.081957 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f3103fad-4c92-4670-9c93-b292a579071e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:26.092234 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f3103fad-4c92-4670-9c93-b292a579071e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.351981 May 26 19:37:26.097802 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 45/85] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:25 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:26.106178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-988f8fba-7eb8-4b95-a86d-3b0ecfd9403a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:26.107851 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-988f8fba-7eb8-4b95-a86d-3b0ecfd9403a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:26.115722 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-988f8fba-7eb8-4b95-a86d-3b0ecfd9403a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:26.116421 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-988f8fba-7eb8-4b95-a86d-3b0ecfd9403a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:26.117631 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-988f8fba-7eb8-4b95-a86d-3b0ecfd9403a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:26.118450 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-988f8fba-7eb8-4b95-a86d-3b0ecfd9403a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:26.184619 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d0cbca2e-5c00-49cd-990b-90f29f79342e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:26.198114 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d0cbca2e-5c00-49cd-990b-90f29f79342e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.355842 May 26 19:37:26.199394 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 41/86] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:25 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:26.683266 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-988f8fba-7eb8-4b95-a86d-3b0ecfd9403a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:26.702086 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-988f8fba-7eb8-4b95-a86d-3b0ecfd9403a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.607481 May 26 19:37:26.716105 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 46/87] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:26 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:27.109843 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-fddbf694-8d4d-4dfc-b982-a18b96534ba5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:27.110519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-fddbf694-8d4d-4dfc-b982-a18b96534ba5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:27.117425 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fddbf694-8d4d-4dfc-b982-a18b96534ba5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:27.117875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fddbf694-8d4d-4dfc-b982-a18b96534ba5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:27.118706 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fddbf694-8d4d-4dfc-b982-a18b96534ba5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:27.119180 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fddbf694-8d4d-4dfc-b982-a18b96534ba5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:27.227373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-818a3996-59a4-4089-a584-ab00d448dc98 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:27.227373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-818a3996-59a4-4089-a584-ab00d448dc98 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:27.227373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818a3996-59a4-4089-a584-ab00d448dc98 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:27.227373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818a3996-59a4-4089-a584-ab00d448dc98 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:27.228367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818a3996-59a4-4089-a584-ab00d448dc98 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:27.228367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818a3996-59a4-4089-a584-ab00d448dc98 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:27.255341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-fddbf694-8d4d-4dfc-b982-a18b96534ba5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:27.262829 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-fddbf694-8d4d-4dfc-b982-a18b96534ba5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.156988 May 26 19:37:27.263441 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 42/88] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:27 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:27.369559 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-818a3996-59a4-4089-a584-ab00d448dc98 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:27.377082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-818a3996-59a4-4089-a584-ab00d448dc98 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.165350 May 26 19:37:27.377651 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 47/89] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:27 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:27.721791 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b1c773dc-3007-48b0-9835-4ef66edbeee1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:27.723483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b1c773dc-3007-48b0-9835-4ef66edbeee1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:27.732172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b1c773dc-3007-48b0-9835-4ef66edbeee1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:27.732626 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b1c773dc-3007-48b0-9835-4ef66edbeee1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:27.733388 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b1c773dc-3007-48b0-9835-4ef66edbeee1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:27.733819 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b1c773dc-3007-48b0-9835-4ef66edbeee1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:27.886551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b1c773dc-3007-48b0-9835-4ef66edbeee1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:27.903631 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b1c773dc-3007-48b0-9835-4ef66edbeee1 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.186414 May 26 19:37:27.906302 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 43/90] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:27 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:28.280416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ea780f7e-5db7-421a-bc43-b9c3d61d7491 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:28.281162 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ea780f7e-5db7-421a-bc43-b9c3d61d7491 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:28.285973 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=30 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:28.288457 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ea780f7e-5db7-421a-bc43-b9c3d61d7491 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:28.288901 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ea780f7e-5db7-421a-bc43-b9c3d61d7491 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:28.289903 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ea780f7e-5db7-421a-bc43-b9c3d61d7491 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:28.290527 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ea780f7e-5db7-421a-bc43-b9c3d61d7491 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:28.394095 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4d70ca82-6b44-4cbb-aa06-9dcdce70440c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:28.397152 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4d70ca82-6b44-4cbb-aa06-9dcdce70440c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:28.403737 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4d70ca82-6b44-4cbb-aa06-9dcdce70440c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:28.404403 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4d70ca82-6b44-4cbb-aa06-9dcdce70440c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:28.414894 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4d70ca82-6b44-4cbb-aa06-9dcdce70440c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:28.415377 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4d70ca82-6b44-4cbb-aa06-9dcdce70440c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:28.432644 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ea780f7e-5db7-421a-bc43-b9c3d61d7491 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:28.441895 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ea780f7e-5db7-421a-bc43-b9c3d61d7491 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.165426 May 26 19:37:28.445056 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 48/91] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:28 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:28.609250 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4d70ca82-6b44-4cbb-aa06-9dcdce70440c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:28.615678 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4d70ca82-6b44-4cbb-aa06-9dcdce70440c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.225371 May 26 19:37:28.625482 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 44/92] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:28 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:28.921907 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5b63474e-20ae-494c-8b12-ab0271386b79 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:28.922520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5b63474e-20ae-494c-8b12-ab0271386b79 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:28.928493 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5b63474e-20ae-494c-8b12-ab0271386b79 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:28.928954 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5b63474e-20ae-494c-8b12-ab0271386b79 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:28.929742 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5b63474e-20ae-494c-8b12-ab0271386b79 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:28.930180 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5b63474e-20ae-494c-8b12-ab0271386b79 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:29.061017 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5b63474e-20ae-494c-8b12-ab0271386b79 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:29.069765 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5b63474e-20ae-494c-8b12-ab0271386b79 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.151772 May 26 19:37:29.070340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 49/93] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:28 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:29.461617 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7a93293b-5530-44b6-8d02-d4737cd9043d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:29.463569 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7a93293b-5530-44b6-8d02-d4737cd9043d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:29.472240 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7a93293b-5530-44b6-8d02-d4737cd9043d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:29.472887 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7a93293b-5530-44b6-8d02-d4737cd9043d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:29.474161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7a93293b-5530-44b6-8d02-d4737cd9043d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:29.474853 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7a93293b-5530-44b6-8d02-d4737cd9043d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:29.633855 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2a4e7c0a-7e87-40fb-b488-3f4978b7efc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:29.635569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2a4e7c0a-7e87-40fb-b488-3f4978b7efc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:29.648971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a4e7c0a-7e87-40fb-b488-3f4978b7efc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:29.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a4e7c0a-7e87-40fb-b488-3f4978b7efc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:29.651762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a4e7c0a-7e87-40fb-b488-3f4978b7efc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:29.652785 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a4e7c0a-7e87-40fb-b488-3f4978b7efc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:29.680406 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7a93293b-5530-44b6-8d02-d4737cd9043d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:29.689643 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7a93293b-5530-44b6-8d02-d4737cd9043d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.233061 May 26 19:37:29.699109 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 45/94] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:29 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:29.927183 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2a4e7c0a-7e87-40fb-b488-3f4978b7efc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:29.935900 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2a4e7c0a-7e87-40fb-b488-3f4978b7efc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.305662 May 26 19:37:29.939187 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 50/95] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:29 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:30.087913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6d35bc39-742c-4e0c-afe6-9484eaef7531 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:30.088521 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6d35bc39-742c-4e0c-afe6-9484eaef7531 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:30.094610 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d35bc39-742c-4e0c-afe6-9484eaef7531 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:30.095097 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d35bc39-742c-4e0c-afe6-9484eaef7531 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:30.095854 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d35bc39-742c-4e0c-afe6-9484eaef7531 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:30.096278 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d35bc39-742c-4e0c-afe6-9484eaef7531 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:30.228995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6d35bc39-742c-4e0c-afe6-9484eaef7531 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:30.237438 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6d35bc39-742c-4e0c-afe6-9484eaef7531 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.154912 May 26 19:37:30.238025 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 46/96] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:30 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:30.706759 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1b66717a-166e-40b0-b2e9-a50b61f6d12d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:30.707562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1b66717a-166e-40b0-b2e9-a50b61f6d12d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:30.714480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1b66717a-166e-40b0-b2e9-a50b61f6d12d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:30.714776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1b66717a-166e-40b0-b2e9-a50b61f6d12d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:30.715575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1b66717a-166e-40b0-b2e9-a50b61f6d12d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:30.716008 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1b66717a-166e-40b0-b2e9-a50b61f6d12d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:30.856599 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1b66717a-166e-40b0-b2e9-a50b61f6d12d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:30.864253 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1b66717a-166e-40b0-b2e9-a50b61f6d12d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.161268 May 26 19:37:30.865477 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 47/97] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:30 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:30.906323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-2ae1e908-ac94-4073-9aca-6dda906d3c90 req-fe2e47fd-30e7-4f35-a0fc-b830bcb798af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26f44b8-4d34-4dde-8e5a-e369b12b8ab1", "name": "network-vif-plugged", "status": "completed", "tag": "603ce21e-f566-48c7-964e-f1beb677bcda"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:30.915065 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-2ae1e908-ac94-4073-9aca-6dda906d3c90 req-fe2e47fd-30e7-4f35-a0fc-b830bcb798af service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:30.915674 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-2ae1e908-ac94-4073-9aca-6dda906d3c90 req-fe2e47fd-30e7-4f35-a0fc-b830bcb798af service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:30.929727 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-2ae1e908-ac94-4073-9aca-6dda906d3c90 req-fe2e47fd-30e7-4f35-a0fc-b830bcb798af service nova] Creating event network-vif-plugged:603ce21e-f566-48c7-964e-f1beb677bcda for instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 on hv-cinder-82549 May 26 19:37:30.935019 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-2ae1e908-ac94-4073-9aca-6dda906d3c90 req-fe2e47fd-30e7-4f35-a0fc-b830bcb798af service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350001 May 26 19:37:30.936313 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 51/98] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:30.953485 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3e786707-554c-487c-b836-79dd01f4b8b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:30.954089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3e786707-554c-487c-b836-79dd01f4b8b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:30.971337 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3e786707-554c-487c-b836-79dd01f4b8b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:30.971786 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3e786707-554c-487c-b836-79dd01f4b8b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:30.974495 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3e786707-554c-487c-b836-79dd01f4b8b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:30.975654 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3e786707-554c-487c-b836-79dd01f4b8b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:31.134454 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3e786707-554c-487c-b836-79dd01f4b8b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:31.142727 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3e786707-554c-487c-b836-79dd01f4b8b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.193051 May 26 19:37:31.143597 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 48/99] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:30 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:31.255788 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-34387d7b-9c27-44ec-a733-b06ff9b4a93a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:31.256496 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-34387d7b-9c27-44ec-a733-b06ff9b4a93a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:31.267753 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34387d7b-9c27-44ec-a733-b06ff9b4a93a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:31.268802 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34387d7b-9c27-44ec-a733-b06ff9b4a93a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:31.269262 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34387d7b-9c27-44ec-a733-b06ff9b4a93a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:31.269885 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34387d7b-9c27-44ec-a733-b06ff9b4a93a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:31.408340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-34387d7b-9c27-44ec-a733-b06ff9b4a93a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:31.416010 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-34387d7b-9c27-44ec-a733-b06ff9b4a93a tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.164493 May 26 19:37:31.416574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 52/100] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:31 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:31.889487 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-554bfba3-a4cf-47f1-a623-0fcc2c700314 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:31.890658 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-554bfba3-a4cf-47f1-a623-0fcc2c700314 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:31.899868 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-554bfba3-a4cf-47f1-a623-0fcc2c700314 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:31.900173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-554bfba3-a4cf-47f1-a623-0fcc2c700314 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:31.900972 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-554bfba3-a4cf-47f1-a623-0fcc2c700314 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:31.901450 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-554bfba3-a4cf-47f1-a623-0fcc2c700314 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:32.063023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-554bfba3-a4cf-47f1-a623-0fcc2c700314 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:32.072123 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-554bfba3-a4cf-47f1-a623-0fcc2c700314 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.189856 May 26 19:37:32.081998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 49/101] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:31 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:32.159049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d4c65056-5c4b-4190-992b-de05276418ba tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:32.159757 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d4c65056-5c4b-4190-992b-de05276418ba tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:32.167580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d4c65056-5c4b-4190-992b-de05276418ba tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:32.167580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d4c65056-5c4b-4190-992b-de05276418ba tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:32.167580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d4c65056-5c4b-4190-992b-de05276418ba tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:32.167838 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d4c65056-5c4b-4190-992b-de05276418ba tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:32.314260 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d4c65056-5c4b-4190-992b-de05276418ba tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:32.323038 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d4c65056-5c4b-4190-992b-de05276418ba tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.167584 May 26 19:37:32.327437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 53/102] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:32 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:32.433126 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-664d5434-c84a-484d-8e86-92a070ee5687 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:32.433732 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-664d5434-c84a-484d-8e86-92a070ee5687 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:32.439674 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-664d5434-c84a-484d-8e86-92a070ee5687 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:32.440120 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-664d5434-c84a-484d-8e86-92a070ee5687 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:32.440877 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-664d5434-c84a-484d-8e86-92a070ee5687 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:32.441312 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-664d5434-c84a-484d-8e86-92a070ee5687 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:32.580635 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-664d5434-c84a-484d-8e86-92a070ee5687 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:32.588251 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-664d5434-c84a-484d-8e86-92a070ee5687 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.158859 May 26 19:37:32.595772 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 50/103] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:32 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:32.971420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-f0ffe36f-6267-4c45-a7a5-a518b60f8696 req-8ea95cb3-8d48-470e-90cb-e704185888d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee8cee6-5c93-4631-a2c1-f371a167fe97", "name": "network-vif-plugged", "status": "completed", "tag": "bb441dd0-8885-4c02-8728-1c89ea5d6a61"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:32.971420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-f0ffe36f-6267-4c45-a7a5-a518b60f8696 req-8ea95cb3-8d48-470e-90cb-e704185888d6 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:32.971420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-f0ffe36f-6267-4c45-a7a5-a518b60f8696 req-8ea95cb3-8d48-470e-90cb-e704185888d6 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:32.974397 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-f0ffe36f-6267-4c45-a7a5-a518b60f8696 req-8ea95cb3-8d48-470e-90cb-e704185888d6 service nova] Creating event network-vif-plugged:bb441dd0-8885-4c02-8728-1c89ea5d6a61 for instance cee8cee6-5c93-4631-a2c1-f371a167fe97 on hv-cinder-82549 May 26 19:37:32.979406 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-f0ffe36f-6267-4c45-a7a5-a518b60f8696 req-8ea95cb3-8d48-470e-90cb-e704185888d6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028578 May 26 19:37:32.980004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 54/104] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:33.089116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1856bf76-169f-4aba-b48e-b07c0fa44ee7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:33.089722 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1856bf76-169f-4aba-b48e-b07c0fa44ee7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:33.095739 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1856bf76-169f-4aba-b48e-b07c0fa44ee7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:33.096180 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1856bf76-169f-4aba-b48e-b07c0fa44ee7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:33.097011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1856bf76-169f-4aba-b48e-b07c0fa44ee7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:33.097700 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1856bf76-169f-4aba-b48e-b07c0fa44ee7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:33.257931 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1856bf76-169f-4aba-b48e-b07c0fa44ee7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:33.267920 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1856bf76-169f-4aba-b48e-b07c0fa44ee7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.182461 May 26 19:37:33.275267 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 51/105] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:33 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:33.340559 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a8e7916d-cde5-4c07-a3ee-218da07626df tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:33.341029 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a8e7916d-cde5-4c07-a3ee-218da07626df tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:33.347424 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a8e7916d-cde5-4c07-a3ee-218da07626df tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:33.347870 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a8e7916d-cde5-4c07-a3ee-218da07626df tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:33.348631 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a8e7916d-cde5-4c07-a3ee-218da07626df tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:33.349057 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a8e7916d-cde5-4c07-a3ee-218da07626df tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:33.491857 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a8e7916d-cde5-4c07-a3ee-218da07626df tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:33.499341 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a8e7916d-cde5-4c07-a3ee-218da07626df tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.163379 May 26 19:37:33.499914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 55/106] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:33 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:33.604974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9090f925-8823-4fe0-90dd-18f69e5b459c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:33.605595 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9090f925-8823-4fe0-90dd-18f69e5b459c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:33.614586 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9090f925-8823-4fe0-90dd-18f69e5b459c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:33.615227 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9090f925-8823-4fe0-90dd-18f69e5b459c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:33.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9090f925-8823-4fe0-90dd-18f69e5b459c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:33.616516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9090f925-8823-4fe0-90dd-18f69e5b459c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:33.749514 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9090f925-8823-4fe0-90dd-18f69e5b459c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:33.757368 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9090f925-8823-4fe0-90dd-18f69e5b459c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.156557 May 26 19:37:33.757939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 52/107] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:33 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:34.286617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3670805e-2760-422b-a5f5-642dce7ddf5c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:34.288236 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3670805e-2760-422b-a5f5-642dce7ddf5c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:34.300760 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3670805e-2760-422b-a5f5-642dce7ddf5c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:34.301553 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3670805e-2760-422b-a5f5-642dce7ddf5c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:34.303369 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3670805e-2760-422b-a5f5-642dce7ddf5c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:34.304046 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3670805e-2760-422b-a5f5-642dce7ddf5c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:34.520238 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-04be4c7e-e2fd-4b64-b83d-55b6400b97a7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:34.522396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-04be4c7e-e2fd-4b64-b83d-55b6400b97a7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:34.539841 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=4 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:34.543096 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04be4c7e-e2fd-4b64-b83d-55b6400b97a7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:34.543096 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04be4c7e-e2fd-4b64-b83d-55b6400b97a7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:34.543096 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04be4c7e-e2fd-4b64-b83d-55b6400b97a7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:34.543634 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04be4c7e-e2fd-4b64-b83d-55b6400b97a7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:34.695591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3670805e-2760-422b-a5f5-642dce7ddf5c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:34.709975 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3670805e-2760-422b-a5f5-642dce7ddf5c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.428025 May 26 19:37:34.710794 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 56/108] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:34 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:34.746723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-04be4c7e-e2fd-4b64-b83d-55b6400b97a7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:34.757431 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-04be4c7e-e2fd-4b64-b83d-55b6400b97a7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.243963 May 26 19:37:34.761231 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 53/109] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:34 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:34.775858 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d061d150-5a3c-44cb-b5eb-1566f641f049 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:34.776585 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d061d150-5a3c-44cb-b5eb-1566f641f049 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:34.790667 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d061d150-5a3c-44cb-b5eb-1566f641f049 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:34.791167 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d061d150-5a3c-44cb-b5eb-1566f641f049 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:34.792098 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d061d150-5a3c-44cb-b5eb-1566f641f049 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:34.792528 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d061d150-5a3c-44cb-b5eb-1566f641f049 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:35.228706 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d061d150-5a3c-44cb-b5eb-1566f641f049 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:35.238082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d061d150-5a3c-44cb-b5eb-1566f641f049 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.467794 May 26 19:37:35.238890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 57/110] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:34 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:35.733247 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-228fa520-e4cb-49e7-8650-e7bd85bc19cb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:35.733978 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-228fa520-e4cb-49e7-8650-e7bd85bc19cb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:35.741748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-228fa520-e4cb-49e7-8650-e7bd85bc19cb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:35.742286 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-228fa520-e4cb-49e7-8650-e7bd85bc19cb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:35.743189 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-228fa520-e4cb-49e7-8650-e7bd85bc19cb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:35.743803 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-228fa520-e4cb-49e7-8650-e7bd85bc19cb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:35.782768 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b6ed3958-2692-435a-ace1-23934dce2aa9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:35.784073 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b6ed3958-2692-435a-ace1-23934dce2aa9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:35.791377 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b6ed3958-2692-435a-ace1-23934dce2aa9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:35.792187 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b6ed3958-2692-435a-ace1-23934dce2aa9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:35.793118 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b6ed3958-2692-435a-ace1-23934dce2aa9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:35.793703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b6ed3958-2692-435a-ace1-23934dce2aa9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:35.914577 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-228fa520-e4cb-49e7-8650-e7bd85bc19cb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:35.935603 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-228fa520-e4cb-49e7-8650-e7bd85bc19cb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.206308 May 26 19:37:35.945576 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 54/111] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:35 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:35.976139 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b6ed3958-2692-435a-ace1-23934dce2aa9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:35.983774 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b6ed3958-2692-435a-ace1-23934dce2aa9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.210543 May 26 19:37:35.984381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 58/112] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:35 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:36.266749 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-921ae7db-25f7-4505-85ad-eea0b735ccd5 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:36.267464 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-921ae7db-25f7-4505-85ad-eea0b735ccd5 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:36.295579 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-921ae7db-25f7-4505-85ad-eea0b735ccd5 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:36.296137 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-921ae7db-25f7-4505-85ad-eea0b735ccd5 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:36.297095 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-921ae7db-25f7-4505-85ad-eea0b735ccd5 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:36.297855 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-921ae7db-25f7-4505-85ad-eea0b735ccd5 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:36.516016 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-921ae7db-25f7-4505-85ad-eea0b735ccd5 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:36.525390 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-921ae7db-25f7-4505-85ad-eea0b735ccd5 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.266322 May 26 19:37:36.526318 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 55/113] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:36 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:36.576906 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-17c15e04-515d-4f45-934e-5aec5f91e252 req-fd59337f-8b29-43e1-bc49-65ecf0d2aa3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdd25a5-210c-4638-95a5-4cf961b1d9d3", "name": "network-vif-plugged", "status": "completed", "tag": "4eedf65c-da1c-48d7-8869-d150a6c93ed0"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:36.586106 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-17c15e04-515d-4f45-934e-5aec5f91e252 req-fd59337f-8b29-43e1-bc49-65ecf0d2aa3e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:36.586579 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-17c15e04-515d-4f45-934e-5aec5f91e252 req-fd59337f-8b29-43e1-bc49-65ecf0d2aa3e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:36.599037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-17c15e04-515d-4f45-934e-5aec5f91e252 req-fd59337f-8b29-43e1-bc49-65ecf0d2aa3e service nova] Creating event network-vif-plugged:4eedf65c-da1c-48d7-8869-d150a6c93ed0 for instance 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 on hv-cinder-82549 May 26 19:37:36.605146 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-17c15e04-515d-4f45-934e-5aec5f91e252 req-fd59337f-8b29-43e1-bc49-65ecf0d2aa3e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035114 May 26 19:37:36.605771 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 59/114] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:36.956048 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0f2488ee-86ab-41d7-af6f-606c2f224809 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:36.956660 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0f2488ee-86ab-41d7-af6f-606c2f224809 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:36.975023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0f2488ee-86ab-41d7-af6f-606c2f224809 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:36.975023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0f2488ee-86ab-41d7-af6f-606c2f224809 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:36.975023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0f2488ee-86ab-41d7-af6f-606c2f224809 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:36.975023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0f2488ee-86ab-41d7-af6f-606c2f224809 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:37.008193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6b227753-f447-4ac4-9596-a95cf5b5d5e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:37.008982 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6b227753-f447-4ac4-9596-a95cf5b5d5e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:37.017745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b227753-f447-4ac4-9596-a95cf5b5d5e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:37.022728 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b227753-f447-4ac4-9596-a95cf5b5d5e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:37.023645 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b227753-f447-4ac4-9596-a95cf5b5d5e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:37.024951 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b227753-f447-4ac4-9596-a95cf5b5d5e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:37.145520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0f2488ee-86ab-41d7-af6f-606c2f224809 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:37.157616 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0f2488ee-86ab-41d7-af6f-606c2f224809 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1367 microversion: 2.1 time: 0.205804 May 26 19:37:37.158612 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 56/115] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:36 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:37.191406 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6b227753-f447-4ac4-9596-a95cf5b5d5e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:37.199374 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6b227753-f447-4ac4-9596-a95cf5b5d5e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.196755 May 26 19:37:37.199971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 60/116] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:37 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:37.543740 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a9fa88cf-a4c3-4989-a96c-c3e9b6f61de6 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:37.544545 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a9fa88cf-a4c3-4989-a96c-c3e9b6f61de6 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:37.550682 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a9fa88cf-a4c3-4989-a96c-c3e9b6f61de6 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:37.551168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a9fa88cf-a4c3-4989-a96c-c3e9b6f61de6 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:37.552034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a9fa88cf-a4c3-4989-a96c-c3e9b6f61de6 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:37.552533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a9fa88cf-a4c3-4989-a96c-c3e9b6f61de6 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:37.759170 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a9fa88cf-a4c3-4989-a96c-c3e9b6f61de6 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:37.762945 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=100 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:37.768496 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a9fa88cf-a4c3-4989-a96c-c3e9b6f61de6 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1314 microversion: 2.1 time: 0.229175 May 26 19:37:37.779498 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 57/117] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:37 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:38.175137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2f2d03e0-6079-4267-b2be-ca4406cf8cf2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:38.175748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2f2d03e0-6079-4267-b2be-ca4406cf8cf2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:38.188572 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2f2d03e0-6079-4267-b2be-ca4406cf8cf2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:38.188572 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2f2d03e0-6079-4267-b2be-ca4406cf8cf2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:38.188572 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2f2d03e0-6079-4267-b2be-ca4406cf8cf2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:38.188572 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2f2d03e0-6079-4267-b2be-ca4406cf8cf2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:38.231212 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-42c2c37f-8d50-4136-a452-05fb0bfd7d57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:38.231851 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-42c2c37f-8d50-4136-a452-05fb0bfd7d57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:38.249973 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-42c2c37f-8d50-4136-a452-05fb0bfd7d57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:38.250421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-42c2c37f-8d50-4136-a452-05fb0bfd7d57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:38.253746 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-42c2c37f-8d50-4136-a452-05fb0bfd7d57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:38.254212 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-42c2c37f-8d50-4136-a452-05fb0bfd7d57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:38.470624 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2f2d03e0-6079-4267-b2be-ca4406cf8cf2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:38.478116 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2f2d03e0-6079-4267-b2be-ca4406cf8cf2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1558 microversion: 2.1 time: 0.306763 May 26 19:37:38.478660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 61/118] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:38 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1558 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:38.480849 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-42c2c37f-8d50-4136-a452-05fb0bfd7d57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:38.488535 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-42c2c37f-8d50-4136-a452-05fb0bfd7d57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.276196 May 26 19:37:38.489129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 58/119] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:38 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:38.495520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-23059d75-6351-4e44-9f5f-6dc761c971a8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:38.496010 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-23059d75-6351-4e44-9f5f-6dc761c971a8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:38.501934 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23059d75-6351-4e44-9f5f-6dc761c971a8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:38.502381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23059d75-6351-4e44-9f5f-6dc761c971a8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:38.503191 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23059d75-6351-4e44-9f5f-6dc761c971a8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:38.503623 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23059d75-6351-4e44-9f5f-6dc761c971a8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:38.532031 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=100 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:38.624753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-7a03b528-8daa-4143-8878-fa5e07599f11 req-a259f542-0bd5-42c0-a833-629a27623212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe881d0-23c9-414a-a94b-8be8035792f4", "name": "network-vif-plugged", "status": "completed", "tag": "40dd7f56-37e3-4a52-a2d9-f04821553aa0"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:38.640121 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-7a03b528-8daa-4143-8878-fa5e07599f11 req-a259f542-0bd5-42c0-a833-629a27623212 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:38.641400 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-7a03b528-8daa-4143-8878-fa5e07599f11 req-a259f542-0bd5-42c0-a833-629a27623212 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:38.655080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-7a03b528-8daa-4143-8878-fa5e07599f11 req-a259f542-0bd5-42c0-a833-629a27623212 service nova] Creating event network-vif-plugged:40dd7f56-37e3-4a52-a2d9-f04821553aa0 for instance ebe881d0-23c9-414a-a94b-8be8035792f4 on hv-cinder-82549 May 26 19:37:38.665412 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-7a03b528-8daa-4143-8878-fa5e07599f11 req-a259f542-0bd5-42c0-a833-629a27623212 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045054 May 26 19:37:38.667116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 59/120] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:37:38.686638 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-23059d75-6351-4e44-9f5f-6dc761c971a8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194782 May 26 19:37:38.687314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 62/121] 10.222.0.72 () {58 vars in 1274 bytes} [Thu May 26 19:37:38 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:38.787502 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1d5b7fc2-b736-4552-a526-d0fa4c940072 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:38.788556 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1d5b7fc2-b736-4552-a526-d0fa4c940072 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:38.796721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1d5b7fc2-b736-4552-a526-d0fa4c940072 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:38.797386 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1d5b7fc2-b736-4552-a526-d0fa4c940072 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:38.798325 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1d5b7fc2-b736-4552-a526-d0fa4c940072 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:38.799318 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1d5b7fc2-b736-4552-a526-d0fa4c940072 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:39.096062 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1d5b7fc2-b736-4552-a526-d0fa4c940072 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:39.104322 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1d5b7fc2-b736-4552-a526-d0fa4c940072 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1502 microversion: 2.1 time: 0.321671 May 26 19:37:39.105143 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 60/122] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:38 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1502 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:39.508473 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e08d5587-c83c-472d-bca8-a93e76b01ded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:39.509324 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e08d5587-c83c-472d-bca8-a93e76b01ded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:39.516030 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e08d5587-c83c-472d-bca8-a93e76b01ded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:39.516538 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e08d5587-c83c-472d-bca8-a93e76b01ded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:39.517693 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e08d5587-c83c-472d-bca8-a93e76b01ded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:39.518347 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e08d5587-c83c-472d-bca8-a93e76b01ded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:39.769615 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e08d5587-c83c-472d-bca8-a93e76b01ded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:39.792872 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e08d5587-c83c-472d-bca8-a93e76b01ded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1321 microversion: 2.1 time: 0.290679 May 26 19:37:39.793628 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 63/123] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:39 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:40.478640 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-6aec6ff9-4277-4aee-9a6e-926fcd76f6d7 req-bb0fb831-bddd-4a4c-bb67-fe84205ac2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee8cee6-5c93-4631-a2c1-f371a167fe97", "tag": "bb441dd0-8885-4c02-8728-1c89ea5d6a61"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:40.486812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-6aec6ff9-4277-4aee-9a6e-926fcd76f6d7 req-bb0fb831-bddd-4a4c-bb67-fe84205ac2a4 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:40.487303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-6aec6ff9-4277-4aee-9a6e-926fcd76f6d7 req-bb0fb831-bddd-4a4c-bb67-fe84205ac2a4 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:40.498201 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-6aec6ff9-4277-4aee-9a6e-926fcd76f6d7 req-bb0fb831-bddd-4a4c-bb67-fe84205ac2a4 service nova] Creating event network-changed:bb441dd0-8885-4c02-8728-1c89ea5d6a61 for instance cee8cee6-5c93-4631-a2c1-f371a167fe97 on hv-cinder-82549 May 26 19:37:40.509344 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-6aec6ff9-4277-4aee-9a6e-926fcd76f6d7 req-bb0fb831-bddd-4a4c-bb67-fe84205ac2a4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034166 May 26 19:37:40.510170 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 61/124] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:40.809736 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a168be21-6a66-4e40-b566-5cf65dae7d8b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:40.810891 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a168be21-6a66-4e40-b566-5cf65dae7d8b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:40.821041 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a168be21-6a66-4e40-b566-5cf65dae7d8b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:40.826207 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a168be21-6a66-4e40-b566-5cf65dae7d8b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:40.827198 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a168be21-6a66-4e40-b566-5cf65dae7d8b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:40.827776 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a168be21-6a66-4e40-b566-5cf65dae7d8b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:41.098582 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a168be21-6a66-4e40-b566-5cf65dae7d8b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:41.116208 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a168be21-6a66-4e40-b566-5cf65dae7d8b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1514 microversion: 2.1 time: 0.308499 May 26 19:37:41.117167 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 64/125] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:40 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1514 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:41.147826 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-eadbb679-5172-4b48-ad18-da3009b4143a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:41.147826 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-eadbb679-5172-4b48-ad18-da3009b4143a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:41.163203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eadbb679-5172-4b48-ad18-da3009b4143a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:41.163891 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eadbb679-5172-4b48-ad18-da3009b4143a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:41.165226 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eadbb679-5172-4b48-ad18-da3009b4143a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:41.165854 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eadbb679-5172-4b48-ad18-da3009b4143a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:41.222809 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3014c9d1-394e-4532-ae57-9dfdb5f21547 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3355ded-e356-46a6-977b-f83838d007de"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:37:41.224834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3014c9d1-394e-4532-ae57-9dfdb5f21547 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:41.236596 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3014c9d1-394e-4532-ae57-9dfdb5f21547 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:41.237062 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3014c9d1-394e-4532-ae57-9dfdb5f21547 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:41.237837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3014c9d1-394e-4532-ae57-9dfdb5f21547 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:41.238269 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3014c9d1-394e-4532-ae57-9dfdb5f21547 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:41.277173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-eadbb679-5172-4b48-ad18-da3009b4143a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lazy-loading 'flavor' on Instance uuid 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:37:41.841713 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-eadbb679-5172-4b48-ad18-da3009b4143a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3/action" status: 200 len: 32 microversion: 2.1 time: 0.709365 May 26 19:37:41.843368 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 62/126] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:37:41 2022] POST /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3/action => generated 32 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 19:37:41.854918 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-34225e14-7c04-43cf-99af-79a9093901ff tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:41.860458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-34225e14-7c04-43cf-99af-79a9093901ff tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:41.889691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-34225e14-7c04-43cf-99af-79a9093901ff tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:41.891282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-34225e14-7c04-43cf-99af-79a9093901ff tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:41.896444 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-34225e14-7c04-43cf-99af-79a9093901ff tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:41.897828 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-34225e14-7c04-43cf-99af-79a9093901ff tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:42.168483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-34225e14-7c04-43cf-99af-79a9093901ff tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:42.176469 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-34225e14-7c04-43cf-99af-79a9093901ff tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.326242 May 26 19:37:42.177115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 63/127] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:41 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:43.034979 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3014c9d1-394e-4532-ae57-9dfdb5f21547 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "POST /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.816432 May 26 19:37:43.035586 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 65/128] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:37:41 2022] POST /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1/os-volume_attachments => generated 194 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:37:43.192620 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-73e86ba1-af5c-4a44-a3b7-b7d63c358a0c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:43.193799 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-73e86ba1-af5c-4a44-a3b7-b7d63c358a0c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:43.205519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-73e86ba1-af5c-4a44-a3b7-b7d63c358a0c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:43.205973 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-73e86ba1-af5c-4a44-a3b7-b7d63c358a0c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:43.206796 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-73e86ba1-af5c-4a44-a3b7-b7d63c358a0c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:43.207264 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-73e86ba1-af5c-4a44-a3b7-b7d63c358a0c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:43.365719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-73e86ba1-af5c-4a44-a3b7-b7d63c358a0c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:43.374335 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-73e86ba1-af5c-4a44-a3b7-b7d63c358a0c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.185004 May 26 19:37:43.374610 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 64/129] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:43 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:44.392094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-816a52cc-d196-49e5-98c4-8843d3355a32 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:44.392789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-816a52cc-d196-49e5-98c4-8843d3355a32 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:44.400802 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-816a52cc-d196-49e5-98c4-8843d3355a32 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:44.401326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-816a52cc-d196-49e5-98c4-8843d3355a32 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:44.402336 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-816a52cc-d196-49e5-98c4-8843d3355a32 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:44.402977 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-816a52cc-d196-49e5-98c4-8843d3355a32 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:44.551217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-816a52cc-d196-49e5-98c4-8843d3355a32 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:44.555867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-816a52cc-d196-49e5-98c4-8843d3355a32 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.169125 May 26 19:37:44.564991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 66/130] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:44 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:45.574302 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-039d959d-8df7-4391-ba05-b70e64a61df5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:45.574942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-039d959d-8df7-4391-ba05-b70e64a61df5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:45.581276 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-039d959d-8df7-4391-ba05-b70e64a61df5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:45.583636 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-039d959d-8df7-4391-ba05-b70e64a61df5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:45.583636 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-039d959d-8df7-4391-ba05-b70e64a61df5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:45.583636 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-039d959d-8df7-4391-ba05-b70e64a61df5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:45.733882 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-039d959d-8df7-4391-ba05-b70e64a61df5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:45.746393 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-039d959d-8df7-4391-ba05-b70e64a61df5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.176884 May 26 19:37:45.747514 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 65/131] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:45 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:46.763850 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a5202388-fb7f-4d95-a414-6168341e6fc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:46.764450 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a5202388-fb7f-4d95-a414-6168341e6fc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:46.782197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5202388-fb7f-4d95-a414-6168341e6fc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:46.783114 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5202388-fb7f-4d95-a414-6168341e6fc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:46.783931 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5202388-fb7f-4d95-a414-6168341e6fc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:46.784485 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5202388-fb7f-4d95-a414-6168341e6fc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:46.935275 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a5202388-fb7f-4d95-a414-6168341e6fc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:46.953965 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a5202388-fb7f-4d95-a414-6168341e6fc3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.193766 May 26 19:37:46.954652 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 67/132] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:46 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:47.973405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f70afdb4-914e-432b-8949-1d8316897422 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:47.973405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f70afdb4-914e-432b-8949-1d8316897422 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:47.978967 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f70afdb4-914e-432b-8949-1d8316897422 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:47.979495 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f70afdb4-914e-432b-8949-1d8316897422 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:47.980472 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f70afdb4-914e-432b-8949-1d8316897422 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:47.981054 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f70afdb4-914e-432b-8949-1d8316897422 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:48.131249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f70afdb4-914e-432b-8949-1d8316897422 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:48.138874 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f70afdb4-914e-432b-8949-1d8316897422 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.171351 May 26 19:37:48.142661 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 66/133] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:47 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:49.157580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b60ae003-03f0-4c87-9d33-f062c8cd7108 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:49.158251 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b60ae003-03f0-4c87-9d33-f062c8cd7108 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:49.165352 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b60ae003-03f0-4c87-9d33-f062c8cd7108 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:49.165793 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b60ae003-03f0-4c87-9d33-f062c8cd7108 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:49.166539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b60ae003-03f0-4c87-9d33-f062c8cd7108 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:49.167000 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b60ae003-03f0-4c87-9d33-f062c8cd7108 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:49.301309 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b60ae003-03f0-4c87-9d33-f062c8cd7108 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:49.313468 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b60ae003-03f0-4c87-9d33-f062c8cd7108 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.158921 May 26 19:37:49.315478 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 68/134] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:49 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:50.332869 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-74d5f234-d6cf-42a2-bcb0-285cec772dc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:50.333737 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-74d5f234-d6cf-42a2-bcb0-285cec772dc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:50.339987 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-74d5f234-d6cf-42a2-bcb0-285cec772dc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:50.340434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-74d5f234-d6cf-42a2-bcb0-285cec772dc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:50.341193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-74d5f234-d6cf-42a2-bcb0-285cec772dc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:50.341623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-74d5f234-d6cf-42a2-bcb0-285cec772dc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:50.480156 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-74d5f234-d6cf-42a2-bcb0-285cec772dc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:50.487943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-74d5f234-d6cf-42a2-bcb0-285cec772dc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.158868 May 26 19:37:50.488518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 67/135] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:50 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:51.504603 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-41e12186-e2c2-4a55-b5fe-b5115df98353 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:51.505215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-41e12186-e2c2-4a55-b5fe-b5115df98353 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:51.512062 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-41e12186-e2c2-4a55-b5fe-b5115df98353 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:51.512513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-41e12186-e2c2-4a55-b5fe-b5115df98353 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:51.513268 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-41e12186-e2c2-4a55-b5fe-b5115df98353 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:51.513698 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-41e12186-e2c2-4a55-b5fe-b5115df98353 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:51.658575 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-41e12186-e2c2-4a55-b5fe-b5115df98353 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:51.671335 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-41e12186-e2c2-4a55-b5fe-b5115df98353 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.166419 May 26 19:37:51.672169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 69/136] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:51 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:52.699527 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4b50a8ef-4dec-4b19-ba38-e500a98224b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:52.701126 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4b50a8ef-4dec-4b19-ba38-e500a98224b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:52.708385 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4b50a8ef-4dec-4b19-ba38-e500a98224b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:52.709606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4b50a8ef-4dec-4b19-ba38-e500a98224b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:52.710586 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4b50a8ef-4dec-4b19-ba38-e500a98224b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:52.711194 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4b50a8ef-4dec-4b19-ba38-e500a98224b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:52.917199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4b50a8ef-4dec-4b19-ba38-e500a98224b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:52.928981 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4b50a8ef-4dec-4b19-ba38-e500a98224b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.232990 May 26 19:37:52.928981 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 68/137] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:52 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:53.118165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-268c6416-f5cf-4533-8910-ee684272ec0c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:53.118826 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-268c6416-f5cf-4533-8910-ee684272ec0c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:53.125468 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-268c6416-f5cf-4533-8910-ee684272ec0c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:53.125911 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-268c6416-f5cf-4533-8910-ee684272ec0c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:53.126664 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-268c6416-f5cf-4533-8910-ee684272ec0c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:53.127178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-268c6416-f5cf-4533-8910-ee684272ec0c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:53.153198 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-268c6416-f5cf-4533-8910-ee684272ec0c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:37:53.944094 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2991a2f2-1ec9-4c18-bd35-d45acfb74fd5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:53.944706 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2991a2f2-1ec9-4c18-bd35-d45acfb74fd5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:53.952518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2991a2f2-1ec9-4c18-bd35-d45acfb74fd5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:53.953273 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2991a2f2-1ec9-4c18-bd35-d45acfb74fd5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:53.954124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2991a2f2-1ec9-4c18-bd35-d45acfb74fd5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:53.954554 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2991a2f2-1ec9-4c18-bd35-d45acfb74fd5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:54.158373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-268c6416-f5cf-4533-8910-ee684272ec0c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 204 len: 0 microversion: 2.1 time: 1.043304 May 26 19:37:54.159987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 70/138] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:37:53 2022] DELETE /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:37:54.179115 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-96571996-a5cf-46de-aaf4-5237886814fe tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:54.182004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-96571996-a5cf-46de-aaf4-5237886814fe tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:54.187760 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2991a2f2-1ec9-4c18-bd35-d45acfb74fd5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:54.198784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2991a2f2-1ec9-4c18-bd35-d45acfb74fd5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.258972 May 26 19:37:54.199624 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 69/139] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:53 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:54.210137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-96571996-a5cf-46de-aaf4-5237886814fe tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:54.211126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-96571996-a5cf-46de-aaf4-5237886814fe tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:54.211404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-96571996-a5cf-46de-aaf4-5237886814fe tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:54.211842 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-96571996-a5cf-46de-aaf4-5237886814fe tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:54.359508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-96571996-a5cf-46de-aaf4-5237886814fe tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:54.369262 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-96571996-a5cf-46de-aaf4-5237886814fe tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1554 microversion: 2.1 time: 0.203979 May 26 19:37:54.370169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 71/140] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:54 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:55.223277 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-fc2e003a-e628-4155-abd3-8621a21bdcbb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:55.223960 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-fc2e003a-e628-4155-abd3-8621a21bdcbb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:55.239249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fc2e003a-e628-4155-abd3-8621a21bdcbb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:55.240623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fc2e003a-e628-4155-abd3-8621a21bdcbb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:55.242761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fc2e003a-e628-4155-abd3-8621a21bdcbb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:55.243783 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fc2e003a-e628-4155-abd3-8621a21bdcbb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:55.387220 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a11e4c47-f6ab-4d97-808a-82fa90bcc694 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:55.387220 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a11e4c47-f6ab-4d97-808a-82fa90bcc694 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:55.395214 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a11e4c47-f6ab-4d97-808a-82fa90bcc694 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:55.395612 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a11e4c47-f6ab-4d97-808a-82fa90bcc694 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:55.396423 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a11e4c47-f6ab-4d97-808a-82fa90bcc694 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:55.396861 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a11e4c47-f6ab-4d97-808a-82fa90bcc694 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:55.466876 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-fc2e003a-e628-4155-abd3-8621a21bdcbb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:55.475899 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-fc2e003a-e628-4155-abd3-8621a21bdcbb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.262206 May 26 19:37:55.476480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 70/141] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:55 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:55.586386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a11e4c47-f6ab-4d97-808a-82fa90bcc694 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:55.594318 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a11e4c47-f6ab-4d97-808a-82fa90bcc694 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1554 microversion: 2.1 time: 0.211507 May 26 19:37:55.594894 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 72/142] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:55 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:56.500124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c3daf286-f6a4-4e87-b04d-57344579ba1f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:56.501313 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c3daf286-f6a4-4e87-b04d-57344579ba1f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:56.508606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=68 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:56.510413 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3daf286-f6a4-4e87-b04d-57344579ba1f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:56.511086 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3daf286-f6a4-4e87-b04d-57344579ba1f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:56.512070 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3daf286-f6a4-4e87-b04d-57344579ba1f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:56.512655 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3daf286-f6a4-4e87-b04d-57344579ba1f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:56.611464 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2d9a86b4-d6e5-4e56-a5f6-948efd00687f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:56.612462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2d9a86b4-d6e5-4e56-a5f6-948efd00687f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:56.624818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:56.635833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2d9a86b4-d6e5-4e56-a5f6-948efd00687f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:56.636811 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2d9a86b4-d6e5-4e56-a5f6-948efd00687f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:56.637975 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2d9a86b4-d6e5-4e56-a5f6-948efd00687f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:56.639901 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2d9a86b4-d6e5-4e56-a5f6-948efd00687f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:56.694427 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c3daf286-f6a4-4e87-b04d-57344579ba1f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:56.703707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c3daf286-f6a4-4e87-b04d-57344579ba1f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.207892 May 26 19:37:56.704342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 71/143] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:56 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:56.946846 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2d9a86b4-d6e5-4e56-a5f6-948efd00687f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:56.956064 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2d9a86b4-d6e5-4e56-a5f6-948efd00687f tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1554 microversion: 2.1 time: 0.348835 May 26 19:37:56.956637 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 73/144] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:56 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1554 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:57.721474 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-47ae546d-5435-4e73-bbf3-dc70e2b3c0be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:57.722210 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-47ae546d-5435-4e73-bbf3-dc70e2b3c0be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:57.729827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-47ae546d-5435-4e73-bbf3-dc70e2b3c0be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:57.730270 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-47ae546d-5435-4e73-bbf3-dc70e2b3c0be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:57.731054 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-47ae546d-5435-4e73-bbf3-dc70e2b3c0be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:57.731712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-47ae546d-5435-4e73-bbf3-dc70e2b3c0be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:57.894232 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-47ae546d-5435-4e73-bbf3-dc70e2b3c0be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:57.904038 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-47ae546d-5435-4e73-bbf3-dc70e2b3c0be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.186959 May 26 19:37:57.904745 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 72/145] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:57 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:57.973431 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5731b5f7-e57c-4090-8d52-d6881e8d15fa tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:57.974055 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5731b5f7-e57c-4090-8d52-d6881e8d15fa tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:57.981568 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5731b5f7-e57c-4090-8d52-d6881e8d15fa tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:57.987543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5731b5f7-e57c-4090-8d52-d6881e8d15fa tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:57.987543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5731b5f7-e57c-4090-8d52-d6881e8d15fa tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:57.987543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5731b5f7-e57c-4090-8d52-d6881e8d15fa tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:58.159307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5731b5f7-e57c-4090-8d52-d6881e8d15fa tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:58.168437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5731b5f7-e57c-4090-8d52-d6881e8d15fa tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1554 microversion: 2.1 time: 0.198841 May 26 19:37:58.169023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 74/146] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:57 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:37:58.921941 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-90963c5e-bae2-41e4-9a15-372e555d2237 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:58.922874 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-90963c5e-bae2-41e4-9a15-372e555d2237 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:58.929830 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-90963c5e-bae2-41e4-9a15-372e555d2237 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:58.930387 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-90963c5e-bae2-41e4-9a15-372e555d2237 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:58.931574 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-90963c5e-bae2-41e4-9a15-372e555d2237 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:58.932080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-90963c5e-bae2-41e4-9a15-372e555d2237 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:59.076869 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-90963c5e-bae2-41e4-9a15-372e555d2237 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:59.080479 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:59.085412 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-90963c5e-bae2-41e4-9a15-372e555d2237 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.167877 May 26 19:37:59.086180 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 73/147] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:58 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:37:59.184947 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7f727b0b-ffae-45eb-8768-636d0a7fc4df tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:37:59.185606 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7f727b0b-ffae-45eb-8768-636d0a7fc4df tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:37:59.192584 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7f727b0b-ffae-45eb-8768-636d0a7fc4df tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:59.193541 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7f727b0b-ffae-45eb-8768-636d0a7fc4df tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:59.194307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7f727b0b-ffae-45eb-8768-636d0a7fc4df tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:37:59.194747 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7f727b0b-ffae-45eb-8768-636d0a7fc4df tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:37:59.349363 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7f727b0b-ffae-45eb-8768-636d0a7fc4df tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:37:59.365515 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7f727b0b-ffae-45eb-8768-636d0a7fc4df tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1554 microversion: 2.1 time: 0.183913 May 26 19:37:59.370093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 75/148] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:37:59 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:00.104990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d931dc6e-cc12-4e5a-8985-626a9074b334 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:00.106614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d931dc6e-cc12-4e5a-8985-626a9074b334 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:00.116203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d931dc6e-cc12-4e5a-8985-626a9074b334 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:00.117294 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d931dc6e-cc12-4e5a-8985-626a9074b334 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:00.118546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d931dc6e-cc12-4e5a-8985-626a9074b334 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:00.119236 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d931dc6e-cc12-4e5a-8985-626a9074b334 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:00.297703 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d931dc6e-cc12-4e5a-8985-626a9074b334 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:00.306895 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d931dc6e-cc12-4e5a-8985-626a9074b334 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.209056 May 26 19:38:00.307622 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 74/149] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:00 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:00.382578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-78a9a9ab-d524-4933-9bd8-50ef10b47882 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:00.383348 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-78a9a9ab-d524-4933-9bd8-50ef10b47882 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:00.395311 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78a9a9ab-d524-4933-9bd8-50ef10b47882 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:00.396116 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78a9a9ab-d524-4933-9bd8-50ef10b47882 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:00.397242 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78a9a9ab-d524-4933-9bd8-50ef10b47882 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:00.398483 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78a9a9ab-d524-4933-9bd8-50ef10b47882 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:00.416826 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:00.545052 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-78a9a9ab-d524-4933-9bd8-50ef10b47882 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:00.554530 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-78a9a9ab-d524-4933-9bd8-50ef10b47882 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1554 microversion: 2.1 time: 0.175350 May 26 19:38:00.555213 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 76/150] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:00 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:01.324648 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-04fe2333-262b-43b8-868b-ce2b892a697e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:01.325284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-04fe2333-262b-43b8-868b-ce2b892a697e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:01.351123 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04fe2333-262b-43b8-868b-ce2b892a697e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:01.351775 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04fe2333-262b-43b8-868b-ce2b892a697e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:01.352915 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04fe2333-262b-43b8-868b-ce2b892a697e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:01.353492 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04fe2333-262b-43b8-868b-ce2b892a697e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:01.517329 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-04fe2333-262b-43b8-868b-ce2b892a697e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:01.526017 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-04fe2333-262b-43b8-868b-ce2b892a697e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.205586 May 26 19:38:01.526587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 75/151] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:01 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:01.572655 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0cceaa92-e8fd-4a3e-bcb2-c03cd0da847d tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:01.573336 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0cceaa92-e8fd-4a3e-bcb2-c03cd0da847d tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:01.580837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0cceaa92-e8fd-4a3e-bcb2-c03cd0da847d tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:01.581286 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0cceaa92-e8fd-4a3e-bcb2-c03cd0da847d tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:01.582054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0cceaa92-e8fd-4a3e-bcb2-c03cd0da847d tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:01.582578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0cceaa92-e8fd-4a3e-bcb2-c03cd0da847d tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:01.723915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0cceaa92-e8fd-4a3e-bcb2-c03cd0da847d tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:01.732818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0cceaa92-e8fd-4a3e-bcb2-c03cd0da847d tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1554 microversion: 2.1 time: 0.164919 May 26 19:38:01.733713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 77/152] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:01 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:02.543651 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-30530495-5c5f-44ea-87ce-a8d0e46a7235 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:02.545287 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-30530495-5c5f-44ea-87ce-a8d0e46a7235 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:02.556609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-30530495-5c5f-44ea-87ce-a8d0e46a7235 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:02.559632 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-30530495-5c5f-44ea-87ce-a8d0e46a7235 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:02.560615 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-30530495-5c5f-44ea-87ce-a8d0e46a7235 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:02.564681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-30530495-5c5f-44ea-87ce-a8d0e46a7235 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:02.618745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-de4b36cc-e722-4b95-95b4-3972da821e1b req-0df3477b-e6d0-4c3a-aacc-049c2a7b5a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26f44b8-4d34-4dde-8e5a-e369b12b8ab1", "name": "network-vif-unplugged", "status": "completed", "tag": "603ce21e-f566-48c7-964e-f1beb677bcda"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:02.633318 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-de4b36cc-e722-4b95-95b4-3972da821e1b req-0df3477b-e6d0-4c3a-aacc-049c2a7b5a06 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:02.634073 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-de4b36cc-e722-4b95-95b4-3972da821e1b req-0df3477b-e6d0-4c3a-aacc-049c2a7b5a06 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:02.646405 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-de4b36cc-e722-4b95-95b4-3972da821e1b req-0df3477b-e6d0-4c3a-aacc-049c2a7b5a06 service nova] Creating event network-vif-unplugged:603ce21e-f566-48c7-964e-f1beb677bcda for instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 on hv-cinder-82549 May 26 19:38:02.655427 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-de4b36cc-e722-4b95-95b4-3972da821e1b req-0df3477b-e6d0-4c3a-aacc-049c2a7b5a06 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040894 May 26 19:38:02.656029 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 78/153] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:38:02.738628 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-30530495-5c5f-44ea-87ce-a8d0e46a7235 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:02.752478 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-de17738e-beef-486a-b880-7717c934c6cb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:02.753435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-de17738e-beef-486a-b880-7717c934c6cb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:02.753698 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-30530495-5c5f-44ea-87ce-a8d0e46a7235 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.214306 May 26 19:38:02.756591 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 76/154] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:02 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:02.767191 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-de17738e-beef-486a-b880-7717c934c6cb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:02.767660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-de17738e-beef-486a-b880-7717c934c6cb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:02.769101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-de17738e-beef-486a-b880-7717c934c6cb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:02.769560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-de17738e-beef-486a-b880-7717c934c6cb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:03.055542 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-de17738e-beef-486a-b880-7717c934c6cb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:03.055542 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-de17738e-beef-486a-b880-7717c934c6cb tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1554 microversion: 2.1 time: 0.292835 May 26 19:38:03.055542 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 79/155] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:02 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1554 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:03.064227 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-b953c7cb-d692-4954-98fc-3cb6129d347d req-38fd2d83-ed48-4a64-a906-f004bdbb89f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26f44b8-4d34-4dde-8e5a-e369b12b8ab1", "name": "network-vif-deleted", "tag": "603ce21e-f566-48c7-964e-f1beb677bcda"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:03.074673 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-b953c7cb-d692-4954-98fc-3cb6129d347d req-38fd2d83-ed48-4a64-a906-f004bdbb89f9 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:03.075294 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-b953c7cb-d692-4954-98fc-3cb6129d347d req-38fd2d83-ed48-4a64-a906-f004bdbb89f9 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:03.087354 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-b953c7cb-d692-4954-98fc-3cb6129d347d req-38fd2d83-ed48-4a64-a906-f004bdbb89f9 service nova] Creating event network-vif-deleted:603ce21e-f566-48c7-964e-f1beb677bcda for instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 on hv-cinder-82549 May 26 19:38:03.092636 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-b953c7cb-d692-4954-98fc-3cb6129d347d req-38fd2d83-ed48-4a64-a906-f004bdbb89f9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038387 May 26 19:38:03.093364 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 77/156] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:38:03.773553 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4fd1fff8-3f78-4867-b6f2-25178347f084 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:03.774194 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4fd1fff8-3f78-4867-b6f2-25178347f084 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:03.780722 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fd1fff8-3f78-4867-b6f2-25178347f084 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:03.781171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fd1fff8-3f78-4867-b6f2-25178347f084 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:03.781930 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fd1fff8-3f78-4867-b6f2-25178347f084 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:03.782369 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fd1fff8-3f78-4867-b6f2-25178347f084 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:03.925036 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4fd1fff8-3f78-4867-b6f2-25178347f084 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:03.934471 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4fd1fff8-3f78-4867-b6f2-25178347f084 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.165292 May 26 19:38:03.936017 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 80/157] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:03 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:04.070526 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-232d30be-3b4a-4df5-bd8a-91e5c457f641 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:04.071333 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-232d30be-3b4a-4df5-bd8a-91e5c457f641 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:04.077746 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-232d30be-3b4a-4df5-bd8a-91e5c457f641 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:04.078275 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-232d30be-3b4a-4df5-bd8a-91e5c457f641 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:04.079189 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-232d30be-3b4a-4df5-bd8a-91e5c457f641 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:04.079697 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-232d30be-3b4a-4df5-bd8a-91e5c457f641 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:04.145827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-232d30be-3b4a-4df5-bd8a-91e5c457f641 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:04.154596 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-232d30be-3b4a-4df5-bd8a-91e5c457f641 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1512 microversion: 2.1 time: 0.088826 May 26 19:38:04.155154 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 78/158] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:04 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1512 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:04.952725 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ff1e3176-7ba2-486d-ab0f-94b4739afc62 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:04.953589 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ff1e3176-7ba2-486d-ab0f-94b4739afc62 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:04.966728 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ff1e3176-7ba2-486d-ab0f-94b4739afc62 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:04.966728 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ff1e3176-7ba2-486d-ab0f-94b4739afc62 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:04.968001 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ff1e3176-7ba2-486d-ab0f-94b4739afc62 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:04.968451 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ff1e3176-7ba2-486d-ab0f-94b4739afc62 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:05.119767 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ff1e3176-7ba2-486d-ab0f-94b4739afc62 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:05.127456 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ff1e3176-7ba2-486d-ab0f-94b4739afc62 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.178645 May 26 19:38:05.128091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 81/159] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:04 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:05.172077 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e5133412-23c9-42aa-8874-1e94afdb5ae3 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:05.172656 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e5133412-23c9-42aa-8874-1e94afdb5ae3 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:05.178966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e5133412-23c9-42aa-8874-1e94afdb5ae3 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:05.179394 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e5133412-23c9-42aa-8874-1e94afdb5ae3 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:05.180210 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e5133412-23c9-42aa-8874-1e94afdb5ae3 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:05.180574 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e5133412-23c9-42aa-8874-1e94afdb5ae3 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:05.243295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e5133412-23c9-42aa-8874-1e94afdb5ae3 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:05.264703 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e5133412-23c9-42aa-8874-1e94afdb5ae3 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1512 microversion: 2.1 time: 0.096447 May 26 19:38:05.265586 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 79/160] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:05 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:06.146435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4ea2efb6-5d7f-44d9-8353-2d791db7a920 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:06.147933 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4ea2efb6-5d7f-44d9-8353-2d791db7a920 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:06.164973 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ea2efb6-5d7f-44d9-8353-2d791db7a920 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:06.165426 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ea2efb6-5d7f-44d9-8353-2d791db7a920 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:06.166205 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ea2efb6-5d7f-44d9-8353-2d791db7a920 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:06.166635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ea2efb6-5d7f-44d9-8353-2d791db7a920 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:06.281619 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-38f3323b-cfb0-4cbd-9a3c-6e3e6723841c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:06.282872 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-38f3323b-cfb0-4cbd-9a3c-6e3e6723841c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:06.290004 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-38f3323b-cfb0-4cbd-9a3c-6e3e6723841c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:06.290693 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-38f3323b-cfb0-4cbd-9a3c-6e3e6723841c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:06.291713 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-38f3323b-cfb0-4cbd-9a3c-6e3e6723841c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:06.292206 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-38f3323b-cfb0-4cbd-9a3c-6e3e6723841c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:06.314458 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4ea2efb6-5d7f-44d9-8353-2d791db7a920 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:06.323556 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4ea2efb6-5d7f-44d9-8353-2d791db7a920 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.182521 May 26 19:38:06.325446 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 82/161] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:06 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:06.371758 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-38f3323b-cfb0-4cbd-9a3c-6e3e6723841c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:06.379771 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-38f3323b-cfb0-4cbd-9a3c-6e3e6723841c tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1345 microversion: 2.1 time: 0.102112 May 26 19:38:06.381245 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 80/162] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:06 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:07.341575 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-20c58450-fd3c-4f85-9b79-36f3168bb45b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:07.342268 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-20c58450-fd3c-4f85-9b79-36f3168bb45b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:07.349662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-20c58450-fd3c-4f85-9b79-36f3168bb45b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:07.350121 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-20c58450-fd3c-4f85-9b79-36f3168bb45b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:07.350997 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-20c58450-fd3c-4f85-9b79-36f3168bb45b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:07.351471 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-20c58450-fd3c-4f85-9b79-36f3168bb45b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:07.398334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b68b450a-b686-4679-89a4-e6b9eca063b2 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:07.399098 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b68b450a-b686-4679-89a4-e6b9eca063b2 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:07.405539 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b68b450a-b686-4679-89a4-e6b9eca063b2 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:07.406057 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b68b450a-b686-4679-89a4-e6b9eca063b2 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:07.406945 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b68b450a-b686-4679-89a4-e6b9eca063b2 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:07.407453 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b68b450a-b686-4679-89a4-e6b9eca063b2 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:07.474238 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b68b450a-b686-4679-89a4-e6b9eca063b2 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:07.482740 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b68b450a-b686-4679-89a4-e6b9eca063b2 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1345 microversion: 2.1 time: 0.089005 May 26 19:38:07.493109 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 81/163] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:07 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:07.500973 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-20c58450-fd3c-4f85-9b79-36f3168bb45b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:07.521121 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-20c58450-fd3c-4f85-9b79-36f3168bb45b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.183343 May 26 19:38:07.521634 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 83/164] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:07 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:08.501055 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:08.501666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:08.507737 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:08.508184 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:08.508955 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:08.509396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:08.538526 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d523ffb9-1e11-49f6-81da-b77b48e769d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:08.539380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d523ffb9-1e11-49f6-81da-b77b48e769d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:08.543080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:08.543609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:08.544250 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lazy-loading 'fault' on Instance uuid b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:38:08.547598 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d523ffb9-1e11-49f6-81da-b77b48e769d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:08.548124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d523ffb9-1e11-49f6-81da-b77b48e769d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:08.549001 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d523ffb9-1e11-49f6-81da-b77b48e769d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:08.549504 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d523ffb9-1e11-49f6-81da-b77b48e769d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:08.603840 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b118c9debc47a6893cca0d336e4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da3140c3a1145dda3ef03959eb8a937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:08.628104 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-81fdc71a-acca-4867-8281-a0af135608f9 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 200 len: 1350 microversion: 2.1 time: 0.130229 May 26 19:38:08.629429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 82/165] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:08 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 1350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:08.731305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d523ffb9-1e11-49f6-81da-b77b48e769d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:08.739679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d523ffb9-1e11-49f6-81da-b77b48e769d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.205967 May 26 19:38:08.740313 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 84/166] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:08 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:09.646686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:09.647322 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:09.653360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:09.653804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:09.654567 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:09.655038 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:09.670488 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] HTTP exception thrown: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Request method failure captured: May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 HTTP/1.1 May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bYoVFt3n8dAL65yJQtP2c3pgupYXpmgVNOXbm7et6n_O9Jd5tc-tDKFZ9hmG8IL-ud2oQXvqUk6pdMPKhP5zhh5bS8cIjfbaT5YvcC_jWiI4EMMt0eE0GlphqSDaBB_9pdS1502oRxjpgpvCPvm4McDPlfIkDsT6MJ11Vwzh_Izi4 May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 5da3140c3a1145dda3ef03959eb8a937 May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-DeleteServersTestJSON-122366368 May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:38:09.675063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5da3140c3a1145dda3ef03959eb8a937", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-DeleteServersTestJSON-122366368 May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 5da3140c3a1145dda3ef03959eb8a937 May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-DeleteServersTestJSON-122366368 May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-DeleteServersTestJSON-122366368-project May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 73b118c9debc47a6893cca0d336e4897 May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-DeleteServersTestJSON-122366368-project May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.676289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': 'b26f44b8-4d34-4dde-8e5a-e369b12b8ab1'} May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:38:09.676996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.678644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.680776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Returning 404 to user: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:38:09.680776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6ceb9591-c0e2-4e4f-846a-c03dce17c5fc tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 404 len: 111 microversion: 2.1 time: 0.033688 May 26 19:38:09.680776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 83/167] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:09 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:38:09.757806 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-93e45bab-e077-4b71-9d85-c3e27c929936 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:09.758487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-93e45bab-e077-4b71-9d85-c3e27c929936 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:09.766122 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-93e45bab-e077-4b71-9d85-c3e27c929936 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:09.766781 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-93e45bab-e077-4b71-9d85-c3e27c929936 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:09.767582 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-93e45bab-e077-4b71-9d85-c3e27c929936 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:09.768032 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-93e45bab-e077-4b71-9d85-c3e27c929936 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:09.795908 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:09.796758 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:09.803220 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:09.803679 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:09.804485 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:09.804923 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:09.818445 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] HTTP exception thrown: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Request method failure captured: May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1/os-volume_attachments HTTP/1.1 May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bYoVFt3n8dAL65yJQtP2c3pgupYXpmgVNOXbm7et6n_O9Jd5tc-tDKFZ9hmG8IL-ud2oQXvqUk6pdMPKhP5zhh5bS8cIjfbaT5YvcC_jWiI4EMMt0eE0GlphqSDaBB_9pdS1502oRxjpgpvCPvm4McDPlfIkDsT6MJ11Vwzh_Izi4 May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 5da3140c3a1145dda3ef03959eb8a937 May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-DeleteServersTestJSON-122366368 May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:38:09.820328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5da3140c3a1145dda3ef03959eb8a937", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-DeleteServersTestJSON-122366368 May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 5da3140c3a1145dda3ef03959eb8a937 May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-DeleteServersTestJSON-122366368 May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-DeleteServersTestJSON-122366368-project May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 73b118c9debc47a6893cca0d336e4897 May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-DeleteServersTestJSON-122366368-project May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.821711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'server_id': 'b26f44b8-4d34-4dde-8e5a-e369b12b8ab1'} May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:38:09.822475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:09.823633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:09.824681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Returning 404 to user: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:38:09.824681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8e934ee6-61f0-4985-91e0-d7d9d4434605 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030621 May 26 19:38:09.824681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 84/168] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:38:09 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:38:09.917861 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-93e45bab-e077-4b71-9d85-c3e27c929936 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:09.925370 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-93e45bab-e077-4b71-9d85-c3e27c929936 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.171712 May 26 19:38:09.925938 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 85/169] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:09 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:10.941528 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-247cc282-7994-44ad-9425-c489c51b6b56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:10.942150 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-247cc282-7994-44ad-9425-c489c51b6b56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:10.948882 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-247cc282-7994-44ad-9425-c489c51b6b56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:10.949334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-247cc282-7994-44ad-9425-c489c51b6b56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:10.950160 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-247cc282-7994-44ad-9425-c489c51b6b56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:10.950595 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-247cc282-7994-44ad-9425-c489c51b6b56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:11.090939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-247cc282-7994-44ad-9425-c489c51b6b56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:11.099966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-247cc282-7994-44ad-9425-c489c51b6b56 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.162312 May 26 19:38:11.100555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 85/170] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:10 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:12.116321 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6265230c-d3ea-4244-983f-d738bd9c7436 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:12.116941 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6265230c-d3ea-4244-983f-d738bd9c7436 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:12.123742 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6265230c-d3ea-4244-983f-d738bd9c7436 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:12.125037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6265230c-d3ea-4244-983f-d738bd9c7436 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:12.125037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6265230c-d3ea-4244-983f-d738bd9c7436 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:12.125474 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6265230c-d3ea-4244-983f-d738bd9c7436 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:12.256620 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6265230c-d3ea-4244-983f-d738bd9c7436 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:12.264078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6265230c-d3ea-4244-983f-d738bd9c7436 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.152049 May 26 19:38:12.264651 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 86/171] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:12 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:13.281598 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-979f15dd-18b2-43f1-a6b8-d365a21ae359 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:13.282200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-979f15dd-18b2-43f1-a6b8-d365a21ae359 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:13.288484 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-979f15dd-18b2-43f1-a6b8-d365a21ae359 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:13.288995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-979f15dd-18b2-43f1-a6b8-d365a21ae359 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:13.289776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-979f15dd-18b2-43f1-a6b8-d365a21ae359 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:13.290185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-979f15dd-18b2-43f1-a6b8-d365a21ae359 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:13.423115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-979f15dd-18b2-43f1-a6b8-d365a21ae359 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:13.431121 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-979f15dd-18b2-43f1-a6b8-d365a21ae359 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.153448 May 26 19:38:13.431708 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 86/172] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:13 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:14.448094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f1c489df-6637-4e7a-afb2-d2987a5e3021 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:14.448707 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f1c489df-6637-4e7a-afb2-d2987a5e3021 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:14.455557 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1c489df-6637-4e7a-afb2-d2987a5e3021 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:14.455943 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1c489df-6637-4e7a-afb2-d2987a5e3021 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:14.456774 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1c489df-6637-4e7a-afb2-d2987a5e3021 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:14.457274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1c489df-6637-4e7a-afb2-d2987a5e3021 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:14.600041 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f1c489df-6637-4e7a-afb2-d2987a5e3021 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:14.608996 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f1c489df-6637-4e7a-afb2-d2987a5e3021 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.165583 May 26 19:38:14.609564 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 87/173] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:14 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:14.957169 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:14.957751 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:14.964120 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:14.964463 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:14.965212 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:14.965638 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:14.980061 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] HTTP exception thrown: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Request method failure captured: May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 HTTP/1.1 May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bYoVFt3n8dAL65yJQtP2c3pgupYXpmgVNOXbm7et6n_O9Jd5tc-tDKFZ9hmG8IL-ud2oQXvqUk6pdMPKhP5zhh5bS8cIjfbaT5YvcC_jWiI4EMMt0eE0GlphqSDaBB_9pdS1502oRxjpgpvCPvm4McDPlfIkDsT6MJ11Vwzh_Izi4 May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 5da3140c3a1145dda3ef03959eb8a937 May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-DeleteServersTestJSON-122366368 May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:38:14.981623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5da3140c3a1145dda3ef03959eb8a937", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-DeleteServersTestJSON-122366368 May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 5da3140c3a1145dda3ef03959eb8a937 May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-DeleteServersTestJSON-122366368 May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-DeleteServersTestJSON-122366368-project May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 73b118c9debc47a6893cca0d336e4897 May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-DeleteServersTestJSON-122366368-project May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:14.982859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': 'b26f44b8-4d34-4dde-8e5a-e369b12b8ab1'} May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:38:14.983551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:14.984570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:38:14.985617 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Returning 404 to user: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:38:14.985617 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4a6a95a1-8de1-4a65-8277-6686a4073971 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 404 len: 111 microversion: 2.1 time: 0.030372 May 26 19:38:14.985617 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 87/174] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:38:14 2022] DELETE /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:38:14.992752 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:14.994391 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] [instance: b26f44b8-4d34-4dde-8e5a-e369b12b8ab1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:15.008579 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:15.008822 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:15.009669 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:15.010173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:15.044938 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] HTTP exception thrown: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Request method failure captured: May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 HTTP/1.1 May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bYoVFt3n8dAL65yJQtP2c3pgupYXpmgVNOXbm7et6n_O9Jd5tc-tDKFZ9hmG8IL-ud2oQXvqUk6pdMPKhP5zhh5bS8cIjfbaT5YvcC_jWiI4EMMt0eE0GlphqSDaBB_9pdS1502oRxjpgpvCPvm4McDPlfIkDsT6MJ11Vwzh_Izi4 May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 5da3140c3a1145dda3ef03959eb8a937 May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-DeleteServersTestJSON-122366368 May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:38:15.050999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5da3140c3a1145dda3ef03959eb8a937", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5da3140c3a1145dda3ef03959eb8a937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-DeleteServersTestJSON-122366368 May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 5da3140c3a1145dda3ef03959eb8a937 May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-DeleteServersTestJSON-122366368 May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-DeleteServersTestJSON-122366368-project May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 73b118c9debc47a6893cca0d336e4897 May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-DeleteServersTestJSON-122366368-project May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:15.052404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'b26f44b8-4d34-4dde-8e5a-e369b12b8ab1'} May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:38:15.053177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. May 26 19:38:15.054445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:15.055734 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] Returning 404 to user: Instance b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:38:15.055734 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4c9afe6b-70e0-4fa1-9a76-687f82bf4793 tempest-DeleteServersTestJSON-122366368 tempest-DeleteServersTestJSON-122366368-project] 10.222.0.72 "GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1" status: 404 len: 111 microversion: 2.1 time: 0.064204 May 26 19:38:15.055734 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 88/175] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:14 2022] GET /compute/v2.1/servers/b26f44b8-4d34-4dde-8e5a-e369b12b8ab1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:38:15.626857 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-82c81950-1126-4286-a7df-0e9ea240a048 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:15.627486 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-82c81950-1126-4286-a7df-0e9ea240a048 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:15.633866 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-82c81950-1126-4286-a7df-0e9ea240a048 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:15.634697 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-82c81950-1126-4286-a7df-0e9ea240a048 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:15.635501 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-82c81950-1126-4286-a7df-0e9ea240a048 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:15.636132 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-82c81950-1126-4286-a7df-0e9ea240a048 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:15.766845 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-82c81950-1126-4286-a7df-0e9ea240a048 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:15.786174 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-82c81950-1126-4286-a7df-0e9ea240a048 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.163074 May 26 19:38:15.787555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 88/176] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:15 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:16.803920 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fc2ff554-849c-484d-a20d-cecad294aea9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:16.804459 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fc2ff554-849c-484d-a20d-cecad294aea9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:16.811680 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fc2ff554-849c-484d-a20d-cecad294aea9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:16.812132 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fc2ff554-849c-484d-a20d-cecad294aea9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:16.812896 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fc2ff554-849c-484d-a20d-cecad294aea9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:16.813335 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fc2ff554-849c-484d-a20d-cecad294aea9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:16.949284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fc2ff554-849c-484d-a20d-cecad294aea9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:16.957319 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fc2ff554-849c-484d-a20d-cecad294aea9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.157248 May 26 19:38:16.957945 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 89/177] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:16 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:17.974825 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4a787b7a-e36b-45fc-ac66-f1188e69805b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:17.975465 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4a787b7a-e36b-45fc-ac66-f1188e69805b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:17.982087 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a787b7a-e36b-45fc-ac66-f1188e69805b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:17.982541 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a787b7a-e36b-45fc-ac66-f1188e69805b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:17.983331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a787b7a-e36b-45fc-ac66-f1188e69805b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:17.983768 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4a787b7a-e36b-45fc-ac66-f1188e69805b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:18.120461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4a787b7a-e36b-45fc-ac66-f1188e69805b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:18.127883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4a787b7a-e36b-45fc-ac66-f1188e69805b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.156968 May 26 19:38:18.128382 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 89/178] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:17 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:19.144727 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9e53aab5-7b41-40e7-8e8e-c68912c4be55 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:19.145337 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9e53aab5-7b41-40e7-8e8e-c68912c4be55 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:19.154006 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9e53aab5-7b41-40e7-8e8e-c68912c4be55 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:19.154457 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9e53aab5-7b41-40e7-8e8e-c68912c4be55 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:19.155592 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9e53aab5-7b41-40e7-8e8e-c68912c4be55 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:19.156030 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9e53aab5-7b41-40e7-8e8e-c68912c4be55 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:19.424656 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9e53aab5-7b41-40e7-8e8e-c68912c4be55 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:19.432242 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9e53aab5-7b41-40e7-8e8e-c68912c4be55 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.290970 May 26 19:38:19.433464 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 90/179] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:19 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:20.449902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-716b264b-bb8b-4e8a-b4d0-dfb9da05931f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:20.450515 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-716b264b-bb8b-4e8a-b4d0-dfb9da05931f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:20.456562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-716b264b-bb8b-4e8a-b4d0-dfb9da05931f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:20.457008 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-716b264b-bb8b-4e8a-b4d0-dfb9da05931f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:20.457827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-716b264b-bb8b-4e8a-b4d0-dfb9da05931f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:20.458258 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-716b264b-bb8b-4e8a-b4d0-dfb9da05931f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:20.616201 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-716b264b-bb8b-4e8a-b4d0-dfb9da05931f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:20.625321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-716b264b-bb8b-4e8a-b4d0-dfb9da05931f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.179847 May 26 19:38:20.626194 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 90/180] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:20 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:21.643314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6182aa2d-a260-4170-b1cf-4a518b923538 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:21.644877 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6182aa2d-a260-4170-b1cf-4a518b923538 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:21.653668 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6182aa2d-a260-4170-b1cf-4a518b923538 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:21.655068 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6182aa2d-a260-4170-b1cf-4a518b923538 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:21.656114 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6182aa2d-a260-4170-b1cf-4a518b923538 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:21.656772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6182aa2d-a260-4170-b1cf-4a518b923538 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:21.883851 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6182aa2d-a260-4170-b1cf-4a518b923538 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:21.892272 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6182aa2d-a260-4170-b1cf-4a518b923538 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.252908 May 26 19:38:21.893003 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 91/181] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:21 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:22.923711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b8c35e5d-cd60-4986-8f71-fd9e709e6ae5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:22.929368 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b8c35e5d-cd60-4986-8f71-fd9e709e6ae5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:22.937190 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b8c35e5d-cd60-4986-8f71-fd9e709e6ae5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:22.937774 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b8c35e5d-cd60-4986-8f71-fd9e709e6ae5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:22.938993 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b8c35e5d-cd60-4986-8f71-fd9e709e6ae5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:22.939556 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b8c35e5d-cd60-4986-8f71-fd9e709e6ae5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:23.232446 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b8c35e5d-cd60-4986-8f71-fd9e709e6ae5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:23.260186 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b8c35e5d-cd60-4986-8f71-fd9e709e6ae5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.353737 May 26 19:38:23.268315 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 91/182] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:22 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:24.149307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3675e716-c3cd-460f-9d56-3d6bb72267e7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'create', calling method: .version_select at 0x7fa788531940>, body: {"keypair": {"name": "tempest-keypair-807550166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4FEfY93k3m3asC8qYHuYQWd74x68jo2QffpBcxhEDglbAdT6ymxuT43CztyhpWL7oFA69leOi280d8nICnQoQX2fqDZmxXF1KP3knaKxFykOxFgUelnsykE7SW/NvbEA=="}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:24.185307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-3675e716-c3cd-460f-9d56-3d6bb72267e7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Getting quotas for project b189404964f64aa88af37e536c1c7464. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:38:24.189307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-3675e716-c3cd-460f-9d56-3d6bb72267e7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Getting quotas for user a1327d80a17743daa137acaad895cd51 and project b189404964f64aa88af37e536c1c7464. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:38:24.285745 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-50c47445-4b0a-4d74-a8a2-67e8c9b3d0cb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:24.286339 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-50c47445-4b0a-4d74-a8a2-67e8c9b3d0cb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:24.295114 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50c47445-4b0a-4d74-a8a2-67e8c9b3d0cb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:24.295569 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50c47445-4b0a-4d74-a8a2-67e8c9b3d0cb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:24.296341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50c47445-4b0a-4d74-a8a2-67e8c9b3d0cb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:24.296776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50c47445-4b0a-4d74-a8a2-67e8c9b3d0cb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:24.363513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3675e716-c3cd-460f-9d56-3d6bb72267e7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.417787 May 26 19:38:24.365403 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 92/183] 10.222.0.72 () {62 vars in 1199 bytes} [Thu May 26 19:38:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 420 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 19:38:24.459355 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-50c47445-4b0a-4d74-a8a2-67e8c9b3d0cb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:24.463317 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=100 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:24.468601 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-50c47445-4b0a-4d74-a8a2-67e8c9b3d0cb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.186835 May 26 19:38:24.469188 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 92/184] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:24 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:25.488205 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-37d8b291-784f-4c53-9760-60f160ae3542 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:25.489967 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-37d8b291-784f-4c53-9760-60f160ae3542 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:25.499607 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37d8b291-784f-4c53-9760-60f160ae3542 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:25.500389 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37d8b291-784f-4c53-9760-60f160ae3542 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:25.501551 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37d8b291-784f-4c53-9760-60f160ae3542 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:25.502178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37d8b291-784f-4c53-9760-60f160ae3542 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:25.651863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-37d8b291-784f-4c53-9760-60f160ae3542 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:25.660599 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-37d8b291-784f-4c53-9760-60f160ae3542 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1520 microversion: 2.1 time: 0.178442 May 26 19:38:25.661540 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 93/185] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:25 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:26.678993 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7cd8662f-c62a-4247-b7da-4e4fdb20c89a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:26.680141 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7cd8662f-c62a-4247-b7da-4e4fdb20c89a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:26.688647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7cd8662f-c62a-4247-b7da-4e4fdb20c89a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:26.690595 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7cd8662f-c62a-4247-b7da-4e4fdb20c89a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:26.691175 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7cd8662f-c62a-4247-b7da-4e4fdb20c89a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:26.692240 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7cd8662f-c62a-4247-b7da-4e4fdb20c89a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:26.976015 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7cd8662f-c62a-4247-b7da-4e4fdb20c89a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:26.984047 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7cd8662f-c62a-4247-b7da-4e4fdb20c89a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1500 microversion: 2.1 time: 0.309098 May 26 19:38:26.985390 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 93/186] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:26 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1500 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:27.006168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a4019437-5013-42ba-a7b6-1fe812eb1b6e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:27.007435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a4019437-5013-42ba-a7b6-1fe812eb1b6e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:27.017764 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4019437-5013-42ba-a7b6-1fe812eb1b6e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:27.024244 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4019437-5013-42ba-a7b6-1fe812eb1b6e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:27.027082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4019437-5013-42ba-a7b6-1fe812eb1b6e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:27.027726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4019437-5013-42ba-a7b6-1fe812eb1b6e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:27.219773 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a4019437-5013-42ba-a7b6-1fe812eb1b6e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:27.228203 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a4019437-5013-42ba-a7b6-1fe812eb1b6e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1515 microversion: 2.1 time: 0.226051 May 26 19:38:27.240468 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 94/187] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:27 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:27.359157 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-618634444", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1378612-5a59-4b7c-a0f1-5080210638d6"}], "security_groups": [{"name": "tempest-securitygroup--2144424448"}], "key_name": "tempest-keypair-807550166", "user_data": "}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:27.475296 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] validate_networks() for [('f1378612-5a59-4b7c-a0f1-5080210638d6', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:38:27.873721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:38:27.874311 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:38:27.874646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:38:27.875079 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:38:27.875520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:38:27.877525 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=52 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:27.885812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:27.886342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:27.887163 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:27.887743 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:27.907182 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Getting quotas for project b189404964f64aa88af37e536c1c7464. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:38:27.912161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Getting quotas for user a1327d80a17743daa137acaad895cd51 and project b189404964f64aa88af37e536c1c7464. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:38:27.926126 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:38:27.929130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:38:28.233853 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d8d431c4-d7da-4013-ba55-268ba7e121a8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.879776 May 26 19:38:28.234506 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 94/188] 10.222.0.72 () {62 vars in 1187 bytes} [Thu May 26 19:38:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 19:38:28.244748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6bb96167-3bd7-4cb2-94e6-09e60f8c74bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:28.245445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6bb96167-3bd7-4cb2-94e6-09e60f8c74bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:28.303037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6bb96167-3bd7-4cb2-94e6-09e60f8c74bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:28.311994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6bb96167-3bd7-4cb2-94e6-09e60f8c74bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:28.315196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6bb96167-3bd7-4cb2-94e6-09e60f8c74bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:28.315196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6bb96167-3bd7-4cb2-94e6-09e60f8c74bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1280 microversion: 2.20 time: 0.073917 May 26 19:38:28.315844 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 95/189] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:28 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:29.333819 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:29.334448 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:29.340779 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:29.341216 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:29.342029 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:29.342455 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:29.403919 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:29.411839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:29.413365 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:29.414462 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-171cd7cd-e365-44ac-9fdd-64239188ad80 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1284 microversion: 2.20 time: 0.084996 May 26 19:38:29.415040 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 95/190] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:29 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:30.432386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:30.432987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:30.435701 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:30.441752 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:30.442201 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:30.443016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:30.443457 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:30.447460 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=100 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:30.505190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:30.513283 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:30.515384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:30.516472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a07d8767-5f8d-4cc3-9cae-6b3ffc3b336c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1284 microversion: 2.20 time: 0.088388 May 26 19:38:30.517030 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 96/191] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:30 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:38:31.535286 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:31.535888 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:31.542266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:31.542705 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:31.543481 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:31.543907 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:31.613900 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:31.621818 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:31.623334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:31.624522 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0628a0a6-dea6-4d07-89aa-a67fd07026b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1276 microversion: 2.20 time: 0.093458 May 26 19:38:31.635440 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 96/192] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:31 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:32.643623 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:32.644231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:32.651703 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:32.652157 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:32.652928 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:32.653379 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:32.719672 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:32.727689 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:32.729204 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:32.730317 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c3c95339-9b85-44c7-ac7c-97d5389adc54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1332 microversion: 2.20 time: 0.090568 May 26 19:38:32.730874 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 97/193] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:32 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:33.291909 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5d31cade-35b8-4a13-9c93-dde5cbf47d25 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:33.292903 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5d31cade-35b8-4a13-9c93-dde5cbf47d25 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:33.298823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5d31cade-35b8-4a13-9c93-dde5cbf47d25 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:33.299290 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5d31cade-35b8-4a13-9c93-dde5cbf47d25 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:33.300035 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5d31cade-35b8-4a13-9c93-dde5cbf47d25 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:33.300463 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5d31cade-35b8-4a13-9c93-dde5cbf47d25 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:33.323156 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-5d31cade-35b8-4a13-9c93-dde5cbf47d25 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lazy-loading 'flavor' on Instance uuid ebe881d0-23c9-414a-a94b-8be8035792f4 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:38:33.689760 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5d31cade-35b8-4a13-9c93-dde5cbf47d25 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4/action" status: 200 len: 32 microversion: 2.1 time: 0.401722 May 26 19:38:33.695245 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 97/194] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:38:33 2022] POST /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4/action => generated 32 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 19:38:33.705736 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-51da1d72-c1a9-4b11-8b42-9ef65efff20e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:33.706344 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-51da1d72-c1a9-4b11-8b42-9ef65efff20e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:33.713584 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-51da1d72-c1a9-4b11-8b42-9ef65efff20e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:33.714024 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-51da1d72-c1a9-4b11-8b42-9ef65efff20e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:33.714861 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-51da1d72-c1a9-4b11-8b42-9ef65efff20e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:33.715350 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-51da1d72-c1a9-4b11-8b42-9ef65efff20e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:33.750486 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:33.751221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:33.757498 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:33.757947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:33.758720 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:33.759190 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:33.995700 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:34.007520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:34.010574 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:34.011993 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-bcac4aec-f521-4d0a-bec2-7557aa138f62 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1406 microversion: 2.20 time: 0.266495 May 26 19:38:34.023722 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 98/195] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:33 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:34.077474 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-51da1d72-c1a9-4b11-8b42-9ef65efff20e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:34.092670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-51da1d72-c1a9-4b11-8b42-9ef65efff20e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.393624 May 26 19:38:34.099259 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 98/196] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:33 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:35.034994 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:35.036525 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:35.047715 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:35.048173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:35.048957 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:35.054234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:35.125463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9952d9f1-45df-45b4-beef-87b7b3c11cc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:35.129278 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9952d9f1-45df-45b4-beef-87b7b3c11cc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:35.157662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9952d9f1-45df-45b4-beef-87b7b3c11cc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:35.158520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9952d9f1-45df-45b4-beef-87b7b3c11cc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:35.163078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9952d9f1-45df-45b4-beef-87b7b3c11cc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:35.164407 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9952d9f1-45df-45b4-beef-87b7b3c11cc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:35.248593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:35.261504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:35.266238 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:35.268129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0eb1dc56-6ff2-4095-ac98-f84e726b7ec1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1406 microversion: 2.20 time: 0.239211 May 26 19:38:35.268880 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 99/197] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:35 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:35.408737 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-f2f4bb1c-8ad6-4328-b62f-63ad8babbe6b req-3e0b6758-d048-45f8-814e-8c4e24505b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "915b2746-efa1-4bc1-897f-dd3382e94a03", "tag": "d5745298-9304-403b-b990-9deaf1756306"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:35.425697 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-f2f4bb1c-8ad6-4328-b62f-63ad8babbe6b req-3e0b6758-d048-45f8-814e-8c4e24505b51 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:35.425697 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-f2f4bb1c-8ad6-4328-b62f-63ad8babbe6b req-3e0b6758-d048-45f8-814e-8c4e24505b51 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:35.436552 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9952d9f1-45df-45b4-beef-87b7b3c11cc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:35.449336 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-f2f4bb1c-8ad6-4328-b62f-63ad8babbe6b req-3e0b6758-d048-45f8-814e-8c4e24505b51 service nova] Creating event network-changed:d5745298-9304-403b-b990-9deaf1756306 for instance 915b2746-efa1-4bc1-897f-dd3382e94a03 on hv-cinder-82549 May 26 19:38:35.449502 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9952d9f1-45df-45b4-beef-87b7b3c11cc4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.335849 May 26 19:38:35.450628 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 99/198] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:35 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:35.454825 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-f2f4bb1c-8ad6-4328-b62f-63ad8babbe6b req-3e0b6758-d048-45f8-814e-8c4e24505b51 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051023 May 26 19:38:35.459358 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 100/199] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:38:36.285726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:36.286951 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:36.320784 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:36.321367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:36.322264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:36.323014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:36.476574 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5ee884f6-ff1b-4d91-86eb-08c8039739b0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:36.478646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5ee884f6-ff1b-4d91-86eb-08c8039739b0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:36.485582 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:36.493344 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5ee884f6-ff1b-4d91-86eb-08c8039739b0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:36.494021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5ee884f6-ff1b-4d91-86eb-08c8039739b0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:36.497465 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5ee884f6-ff1b-4d91-86eb-08c8039739b0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:36.497465 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5ee884f6-ff1b-4d91-86eb-08c8039739b0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:36.499771 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:36.502403 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:36.504762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c704bc36-b3dd-490b-bc7e-5354e7c88b26 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1406 microversion: 2.20 time: 0.222571 May 26 19:38:36.521123 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 100/200] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:36 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:38:36.678881 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5ee884f6-ff1b-4d91-86eb-08c8039739b0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:36.689910 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5ee884f6-ff1b-4d91-86eb-08c8039739b0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.218926 May 26 19:38:36.690782 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 101/201] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:36 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:37.528760 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:37.529443 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:37.536093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:37.536543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:37.537309 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:37.537743 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:37.708155 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-58fb6567-56ad-4582-9999-a8cc08a969e7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:37.708768 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-58fb6567-56ad-4582-9999-a8cc08a969e7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:37.713490 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:37.716266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58fb6567-56ad-4582-9999-a8cc08a969e7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:37.716711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58fb6567-56ad-4582-9999-a8cc08a969e7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:37.720444 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58fb6567-56ad-4582-9999-a8cc08a969e7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:37.721082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58fb6567-56ad-4582-9999-a8cc08a969e7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:37.724672 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:37.726197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:37.731139 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0bf6b2ff-98b5-45c6-80ea-007f7ed9d975 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1406 microversion: 2.20 time: 0.206610 May 26 19:38:37.752176 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 101/202] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:37 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:37.896249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:37.921041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=6 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:37.934135 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-58fb6567-56ad-4582-9999-a8cc08a969e7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:37.943840 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-58fb6567-56ad-4582-9999-a8cc08a969e7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.240214 May 26 19:38:37.944519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 102/203] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:37 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:38.749872 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:38.750470 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:38.752613 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=6 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:38.758087 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:38.758586 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:38.759365 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:38.759796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:38.895088 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:38.903416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:38.904862 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:38.905955 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-833e707b-293c-4bbf-83b7-6bbf7114d726 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1406 microversion: 2.20 time: 0.160222 May 26 19:38:38.906507 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 102/204] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:38 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:38.966432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b88fc89b-6184-49a0-bfa9-3e51caf6fcd3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:38.967080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b88fc89b-6184-49a0-bfa9-3e51caf6fcd3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:38.973429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b88fc89b-6184-49a0-bfa9-3e51caf6fcd3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:38.973879 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b88fc89b-6184-49a0-bfa9-3e51caf6fcd3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:38.974638 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b88fc89b-6184-49a0-bfa9-3e51caf6fcd3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:38.975104 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b88fc89b-6184-49a0-bfa9-3e51caf6fcd3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:39.142406 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b88fc89b-6184-49a0-bfa9-3e51caf6fcd3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:39.150833 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b88fc89b-6184-49a0-bfa9-3e51caf6fcd3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.188984 May 26 19:38:39.151440 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 103/205] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:38 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:39.927595 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:39.929328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:39.941720 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:39.943349 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:39.944526 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:39.945122 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:40.146220 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:40.155530 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:40.157140 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:40.158362 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-86f06ff7-00be-468e-9f3d-51b4a3fa75de tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1406 microversion: 2.20 time: 0.238620 May 26 19:38:40.168605 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 103/206] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:39 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:40.174679 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f88069b7-94ac-4107-aeaa-75a5faa9438d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:40.175550 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f88069b7-94ac-4107-aeaa-75a5faa9438d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:40.181839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f88069b7-94ac-4107-aeaa-75a5faa9438d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:40.182356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f88069b7-94ac-4107-aeaa-75a5faa9438d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:40.183440 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f88069b7-94ac-4107-aeaa-75a5faa9438d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:40.184089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f88069b7-94ac-4107-aeaa-75a5faa9438d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:40.343235 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f88069b7-94ac-4107-aeaa-75a5faa9438d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:40.350855 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f88069b7-94ac-4107-aeaa-75a5faa9438d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.183256 May 26 19:38:40.358959 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 104/207] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:40 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:41.176310 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:41.176915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:41.183475 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:41.184137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:41.184899 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:41.185340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:41.330271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:41.338516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:41.340060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:41.341159 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b8bb9361-11f7-42d9-8f02-ae2ade14684c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1406 microversion: 2.20 time: 0.168791 May 26 19:38:41.341723 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 104/208] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:41 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:41.368433 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6af925cc-ca1a-4b00-8b1a-2f4819607d42 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:41.369145 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6af925cc-ca1a-4b00-8b1a-2f4819607d42 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:41.375393 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6af925cc-ca1a-4b00-8b1a-2f4819607d42 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:41.375842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6af925cc-ca1a-4b00-8b1a-2f4819607d42 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:41.376605 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6af925cc-ca1a-4b00-8b1a-2f4819607d42 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:41.377039 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6af925cc-ca1a-4b00-8b1a-2f4819607d42 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:41.522524 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6af925cc-ca1a-4b00-8b1a-2f4819607d42 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:41.532455 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6af925cc-ca1a-4b00-8b1a-2f4819607d42 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.167824 May 26 19:38:41.533181 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 105/209] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:41 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:42.089992 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-135556a0-4fce-45bf-a5a2-a76c9060ea67 req-d0afa3ce-b503-43d5-b839-e6e650991aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915b2746-efa1-4bc1-897f-dd3382e94a03", "name": "network-vif-plugged", "status": "completed", "tag": "d5745298-9304-403b-b990-9deaf1756306"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:42.121747 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-135556a0-4fce-45bf-a5a2-a76c9060ea67 req-d0afa3ce-b503-43d5-b839-e6e650991aae service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:42.121747 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-135556a0-4fce-45bf-a5a2-a76c9060ea67 req-d0afa3ce-b503-43d5-b839-e6e650991aae service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:42.131187 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-135556a0-4fce-45bf-a5a2-a76c9060ea67 req-d0afa3ce-b503-43d5-b839-e6e650991aae service nova] Creating event network-vif-plugged:d5745298-9304-403b-b990-9deaf1756306 for instance 915b2746-efa1-4bc1-897f-dd3382e94a03 on hv-cinder-82549 May 26 19:38:42.136464 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-135556a0-4fce-45bf-a5a2-a76c9060ea67 req-d0afa3ce-b503-43d5-b839-e6e650991aae service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050519 May 26 19:38:42.138077 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 105/210] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:38:42.360308 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:42.360911 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:42.367562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:42.368077 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:42.368912 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:42.369437 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:42.552097 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2158f83f-5cd4-4949-bde3-7ac1e88afded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:42.554308 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2158f83f-5cd4-4949-bde3-7ac1e88afded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:42.564538 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2158f83f-5cd4-4949-bde3-7ac1e88afded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:42.565665 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2158f83f-5cd4-4949-bde3-7ac1e88afded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:42.567205 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2158f83f-5cd4-4949-bde3-7ac1e88afded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:42.567968 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2158f83f-5cd4-4949-bde3-7ac1e88afded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:42.807876 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:42.816404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:42.821779 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:42.823050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ef922e85-22d0-48b5-b313-8abb318be160 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1406 microversion: 2.20 time: 0.467129 May 26 19:38:42.823623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 106/211] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:42 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:42.877047 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2158f83f-5cd4-4949-bde3-7ac1e88afded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:42.888697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2158f83f-5cd4-4949-bde3-7ac1e88afded tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.342573 May 26 19:38:42.889565 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 106/212] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:42 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:43.840848 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:43.841453 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:43.847660 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:43.848461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:43.849225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:43.849655 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:43.905847 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f186317a-d017-4a8f-b4ab-d941d725442a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:43.906452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f186317a-d017-4a8f-b4ab-d941d725442a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:43.915969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f186317a-d017-4a8f-b4ab-d941d725442a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:43.916420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f186317a-d017-4a8f-b4ab-d941d725442a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:43.917891 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f186317a-d017-4a8f-b4ab-d941d725442a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:43.918548 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f186317a-d017-4a8f-b4ab-d941d725442a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:43.980513 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:43.989467 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:43.990980 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:43.992085 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5be37798-6df0-443b-a46c-b7c332276482 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1406 microversion: 2.20 time: 0.155179 May 26 19:38:43.992646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 107/213] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:43 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:44.132814 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f186317a-d017-4a8f-b4ab-d941d725442a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:44.140478 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f186317a-d017-4a8f-b4ab-d941d725442a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.238683 May 26 19:38:44.141252 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 107/214] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:43 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:45.009886 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:45.010498 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:45.016577 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:45.017030 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:45.017791 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:45.018225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:45.158073 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6b31987f-892b-4e1c-a7dd-f35c40a01f59 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:45.158526 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:45.159599 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6b31987f-892b-4e1c-a7dd-f35c40a01f59 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:45.161863 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:45.167833 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:45.169438 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:45.170618 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-baff4c12-0747-4c11-a3d6-a1b0416a2faa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1599 microversion: 2.20 time: 0.164727 May 26 19:38:45.171467 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 108/215] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:38:45 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:38:45.185596 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b31987f-892b-4e1c-a7dd-f35c40a01f59 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:45.185596 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b31987f-892b-4e1c-a7dd-f35c40a01f59 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:45.185596 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b31987f-892b-4e1c-a7dd-f35c40a01f59 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:45.185596 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b31987f-892b-4e1c-a7dd-f35c40a01f59 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:45.196794 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9c5b2081-9265-4a1a-ab48-5a59d1a26799 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:45.198549 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9c5b2081-9265-4a1a-ab48-5a59d1a26799 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:45.214390 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9c5b2081-9265-4a1a-ab48-5a59d1a26799 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:45.214390 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9c5b2081-9265-4a1a-ab48-5a59d1a26799 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:45.214775 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9c5b2081-9265-4a1a-ab48-5a59d1a26799 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:45.215239 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9c5b2081-9265-4a1a-ab48-5a59d1a26799 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:45.325599 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9c5b2081-9265-4a1a-ab48-5a59d1a26799 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.135370 May 26 19:38:45.326379 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 109/216] 10.222.0.72 () {60 vars in 1315 bytes} [Thu May 26 19:38:45 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:38:45.382297 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6b31987f-892b-4e1c-a7dd-f35c40a01f59 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:45.391986 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6b31987f-892b-4e1c-a7dd-f35c40a01f59 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.238316 May 26 19:38:45.396871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 108/217] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:45 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:38:46.411175 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d72e8e0d-3805-48cb-b3f9-943a9b47934e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:46.412225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d72e8e0d-3805-48cb-b3f9-943a9b47934e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:46.430425 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d72e8e0d-3805-48cb-b3f9-943a9b47934e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:46.436069 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d72e8e0d-3805-48cb-b3f9-943a9b47934e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:46.437658 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d72e8e0d-3805-48cb-b3f9-943a9b47934e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:46.438116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d72e8e0d-3805-48cb-b3f9-943a9b47934e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:46.718864 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d72e8e0d-3805-48cb-b3f9-943a9b47934e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:46.729114 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d72e8e0d-3805-48cb-b3f9-943a9b47934e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.323982 May 26 19:38:46.743910 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 110/218] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:46 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:46.805533 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-4c8c1909-1c7c-42ac-8742-8b0bef3fe0da req-cdb83f66-ffea-4081-bb40-1994d456aa2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "915b2746-efa1-4bc1-897f-dd3382e94a03", "tag": "d5745298-9304-403b-b990-9deaf1756306"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:46.817134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-4c8c1909-1c7c-42ac-8742-8b0bef3fe0da req-cdb83f66-ffea-4081-bb40-1994d456aa2e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:46.817880 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-4c8c1909-1c7c-42ac-8742-8b0bef3fe0da req-cdb83f66-ffea-4081-bb40-1994d456aa2e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:46.834997 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-4c8c1909-1c7c-42ac-8742-8b0bef3fe0da req-cdb83f66-ffea-4081-bb40-1994d456aa2e service nova] Creating event network-changed:d5745298-9304-403b-b990-9deaf1756306 for instance 915b2746-efa1-4bc1-897f-dd3382e94a03 on hv-cinder-82549 May 26 19:38:46.840784 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-4c8c1909-1c7c-42ac-8742-8b0bef3fe0da req-cdb83f66-ffea-4081-bb40-1994d456aa2e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039142 May 26 19:38:46.841637 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 109/219] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:38:47.751866 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e2cbaf3b-6db9-4cd9-83b1-b1a627e99403 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:47.753398 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e2cbaf3b-6db9-4cd9-83b1-b1a627e99403 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:47.767504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e2cbaf3b-6db9-4cd9-83b1-b1a627e99403 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:47.768141 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e2cbaf3b-6db9-4cd9-83b1-b1a627e99403 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:47.768938 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e2cbaf3b-6db9-4cd9-83b1-b1a627e99403 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:47.769395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e2cbaf3b-6db9-4cd9-83b1-b1a627e99403 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:47.974065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e2cbaf3b-6db9-4cd9-83b1-b1a627e99403 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:47.984184 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e2cbaf3b-6db9-4cd9-83b1-b1a627e99403 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.238451 May 26 19:38:47.988113 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 111/220] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:47 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:48.261417 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-88ca5f52-3e74-473d-98c1-21a809569bd4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:48.261999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-88ca5f52-3e74-473d-98c1-21a809569bd4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:48.273030 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-88ca5f52-3e74-473d-98c1-21a809569bd4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:48.273486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-88ca5f52-3e74-473d-98c1-21a809569bd4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:48.277432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-88ca5f52-3e74-473d-98c1-21a809569bd4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:48.277946 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-88ca5f52-3e74-473d-98c1-21a809569bd4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:48.331445 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-88ca5f52-3e74-473d-98c1-21a809569bd4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/ips" status: 200 len: 151 microversion: 2.1 time: 0.074318 May 26 19:38:48.332031 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 110/221] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:38:48 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/ips => generated 151 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:38:49.001740 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7e3ce126-07d6-489f-be69-832cea454624 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:49.002323 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7e3ce126-07d6-489f-be69-832cea454624 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:49.008827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7e3ce126-07d6-489f-be69-832cea454624 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:49.009274 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7e3ce126-07d6-489f-be69-832cea454624 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:49.010045 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7e3ce126-07d6-489f-be69-832cea454624 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:49.010495 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7e3ce126-07d6-489f-be69-832cea454624 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:49.207261 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7e3ce126-07d6-489f-be69-832cea454624 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:49.219263 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7e3ce126-07d6-489f-be69-832cea454624 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1501 microversion: 2.1 time: 0.221790 May 26 19:38:49.220766 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 112/222] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:48 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:49.243300 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db0f5e4c-b130-41a6-a4f6-c50d657b1edd"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:49.244976 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:49.256032 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:49.256032 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:49.256787 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:49.257662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:49.285786 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] HTTP exception thrown: Cannot 'attach_volume' instance ebe881d0-23c9-414a-a94b-8be8035792f4 while it is in vm_state rescued May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Request method failure captured: May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: POST /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4/os-volume_attachments HTTP/1.1 May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 74 May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bk-wWCrmDu3OZPPjGfGavhx6ia2Eyb0y9MeDKXOg5P9P_grBQpBxNjv2BirTX3fBsSVTAVkwePvf99LDpsNyrGPxHS5r2J07Cyp_VAt50gwM4c42wDr0Kb3F0ETLaB9On5ikFz8URDxONdpFnJS2OXZ7NgZiRJLg7Vui1vzIRTa2E May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:38:49.287683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bf99d88fec9046608e464a5e2c75506e", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 9a0e96324450438699abfcefec6d1a6d May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {"volumeAttachment": {"volumeId": "db0f5e4c-b130-41a6-a4f6-c50d657b1edd"}} May 26 19:38:49.289178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Cannot 'attach_volume' instance ebe881d0-23c9-414a-a94b-8be8035792f4 while it is in vm_state rescued May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'server_id': 'ebe881d0-23c9-414a-a94b-8be8035792f4', 'body': {'volumeAttachment': {'volumeId': 'db0f5e4c-b130-41a6-a4f6-c50d657b1edd'}}} May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ebe881d0-23c9-414a-a94b-8be8035792f4 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:38:49.290127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ebe881d0-23c9-414a-a94b-8be8035792f4 while it is in vm_state rescued May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:38:49.291435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:38:49.292709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:38:49.292709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:38:49.292709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ebe881d0-23c9-414a-a94b-8be8035792f4 while it is in vm_state rescued May 26 19:38:49.292709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:38:49.292709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Returning 409 to user: Cannot 'attach_volume' instance ebe881d0-23c9-414a-a94b-8be8035792f4 while it is in vm_state rescued {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:38:49.292709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6b1cea94-faab-488c-b84d-49ec242f6ee6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050963 May 26 19:38:49.293904 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 111/223] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:38:49 2022] POST /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 19:38:49.299369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7e2216eb-5fd6-49ad-b197-f87c98c5c7e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:49.304402 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7e2216eb-5fd6-49ad-b197-f87c98c5c7e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:49.306252 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7e2216eb-5fd6-49ad-b197-f87c98c5c7e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:49.306707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7e2216eb-5fd6-49ad-b197-f87c98c5c7e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:49.307523 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7e2216eb-5fd6-49ad-b197-f87c98c5c7e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:49.307960 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7e2216eb-5fd6-49ad-b197-f87c98c5c7e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:49.538328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7e2216eb-5fd6-49ad-b197-f87c98c5c7e6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4/action" status: 202 len: 0 microversion: 2.1 time: 0.243270 May 26 19:38:49.543784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 113/224] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:38:49 2022] POST /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:38:49.548945 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-42325f48-743c-45cf-98e9-d530d4cdd6d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:49.549630 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-42325f48-743c-45cf-98e9-d530d4cdd6d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:49.556549 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42325f48-743c-45cf-98e9-d530d4cdd6d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:49.557218 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42325f48-743c-45cf-98e9-d530d4cdd6d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:49.558250 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42325f48-743c-45cf-98e9-d530d4cdd6d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:49.559085 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42325f48-743c-45cf-98e9-d530d4cdd6d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:49.741448 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-42325f48-743c-45cf-98e9-d530d4cdd6d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:49.755333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-42325f48-743c-45cf-98e9-d530d4cdd6d9 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1509 microversion: 2.1 time: 0.209845 May 26 19:38:49.756818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 112/225] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:49 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:50.774408 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-12350ee5-d008-498f-a5fd-81e3eb672172 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:50.776620 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-12350ee5-d008-498f-a5fd-81e3eb672172 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:50.783068 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-12350ee5-d008-498f-a5fd-81e3eb672172 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:50.783516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-12350ee5-d008-498f-a5fd-81e3eb672172 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:50.784279 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-12350ee5-d008-498f-a5fd-81e3eb672172 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:50.784870 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-12350ee5-d008-498f-a5fd-81e3eb672172 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:50.928863 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-12350ee5-d008-498f-a5fd-81e3eb672172 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:50.937067 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-12350ee5-d008-498f-a5fd-81e3eb672172 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1509 microversion: 2.1 time: 0.167007 May 26 19:38:50.938165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 114/226] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:50 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:51.954117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-00dd5ece-6502-4968-a50e-db2d36666381 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:51.956282 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-00dd5ece-6502-4968-a50e-db2d36666381 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:51.964100 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00dd5ece-6502-4968-a50e-db2d36666381 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:51.965009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00dd5ece-6502-4968-a50e-db2d36666381 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:51.966095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00dd5ece-6502-4968-a50e-db2d36666381 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:51.967215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00dd5ece-6502-4968-a50e-db2d36666381 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:52.195258 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-00dd5ece-6502-4968-a50e-db2d36666381 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:52.205650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-00dd5ece-6502-4968-a50e-db2d36666381 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1509 microversion: 2.1 time: 0.255676 May 26 19:38:52.217184 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 113/227] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:51 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:52.379823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b89b236d-754f-493c-9295-b7569f634d50 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be490104-3881-41b7-8116-52333e23e482"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:38:52.381011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b89b236d-754f-493c-9295-b7569f634d50 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:52.390302 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b89b236d-754f-493c-9295-b7569f634d50 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:52.390814 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b89b236d-754f-493c-9295-b7569f634d50 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:52.392227 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b89b236d-754f-493c-9295-b7569f634d50 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:52.392671 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b89b236d-754f-493c-9295-b7569f634d50 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:53.223471 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ac394c58-47e3-4948-8e9c-a8c7c59db08a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:53.224255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ac394c58-47e3-4948-8e9c-a8c7c59db08a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:53.242965 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ac394c58-47e3-4948-8e9c-a8c7c59db08a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:53.243507 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ac394c58-47e3-4948-8e9c-a8c7c59db08a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:53.244278 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ac394c58-47e3-4948-8e9c-a8c7c59db08a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:53.244717 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ac394c58-47e3-4948-8e9c-a8c7c59db08a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:53.704484 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ac394c58-47e3-4948-8e9c-a8c7c59db08a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:53.706925 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=100 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:53.713236 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ac394c58-47e3-4948-8e9c-a8c7c59db08a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1509 microversion: 2.1 time: 0.493669 May 26 19:38:53.713819 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 114/228] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:53 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1509 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:54.371551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b89b236d-754f-493c-9295-b7569f634d50 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.998901 May 26 19:38:54.372045 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 115/229] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:38:52 2022] POST /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments => generated 194 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:38:54.731796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-39f64ad2-50c7-484a-b4fb-0ff72968049a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:54.732407 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-39f64ad2-50c7-484a-b4fb-0ff72968049a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:54.742395 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39f64ad2-50c7-484a-b4fb-0ff72968049a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:54.742985 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39f64ad2-50c7-484a-b4fb-0ff72968049a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:54.743813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39f64ad2-50c7-484a-b4fb-0ff72968049a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:54.744307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39f64ad2-50c7-484a-b4fb-0ff72968049a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:54.904043 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-39f64ad2-50c7-484a-b4fb-0ff72968049a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:54.912487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-39f64ad2-50c7-484a-b4fb-0ff72968049a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1509 microversion: 2.1 time: 0.184708 May 26 19:38:54.913358 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 115/230] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:54 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:55.939229 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b54364ac-6c7f-4f14-9bda-dde95d6d5e12 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:55.940586 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b54364ac-6c7f-4f14-9bda-dde95d6d5e12 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:55.947441 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b54364ac-6c7f-4f14-9bda-dde95d6d5e12 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:55.947923 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b54364ac-6c7f-4f14-9bda-dde95d6d5e12 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:55.948706 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b54364ac-6c7f-4f14-9bda-dde95d6d5e12 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:55.949144 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b54364ac-6c7f-4f14-9bda-dde95d6d5e12 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:56.156658 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b54364ac-6c7f-4f14-9bda-dde95d6d5e12 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:56.165428 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b54364ac-6c7f-4f14-9bda-dde95d6d5e12 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1509 microversion: 2.1 time: 0.230494 May 26 19:38:56.175736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 116/231] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:55 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:57.184783 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d1aef908-b0ba-4055-8697-3bdccf76bd49 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:57.185616 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d1aef908-b0ba-4055-8697-3bdccf76bd49 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:57.195656 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d1aef908-b0ba-4055-8697-3bdccf76bd49 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:57.196384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d1aef908-b0ba-4055-8697-3bdccf76bd49 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:57.197558 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d1aef908-b0ba-4055-8697-3bdccf76bd49 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:57.198523 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d1aef908-b0ba-4055-8697-3bdccf76bd49 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:57.572046 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d1aef908-b0ba-4055-8697-3bdccf76bd49 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:57.627589 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d1aef908-b0ba-4055-8697-3bdccf76bd49 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1509 microversion: 2.1 time: 0.443983 May 26 19:38:57.628279 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 116/232] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:57 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1509 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:38:58.649083 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ad17ba99-d777-4625-8a68-fa039f69a3f1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:38:58.649876 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ad17ba99-d777-4625-8a68-fa039f69a3f1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:38:58.678991 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad17ba99-d777-4625-8a68-fa039f69a3f1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:58.679685 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad17ba99-d777-4625-8a68-fa039f69a3f1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:58.680635 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad17ba99-d777-4625-8a68-fa039f69a3f1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:38:58.681405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad17ba99-d777-4625-8a68-fa039f69a3f1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:38:58.961364 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ad17ba99-d777-4625-8a68-fa039f69a3f1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:38:58.972403 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ad17ba99-d777-4625-8a68-fa039f69a3f1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1515 microversion: 2.1 time: 0.331252 May 26 19:38:58.974098 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 117/233] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:38:58 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:01.348695 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ce8e5beb-4d72-4eac-801f-c0bd0ae6fea6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'create', calling method: .version_select at 0x7fa7883dfa60>, body: {"keypair": {"name": "tempest-keypair-1981778791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Ciz/5/M5if+6sYmCWC7mn60UwXYINWzKB0b1bCvpGKHMsclinWwbP9XDDBgGtYqc1dqOdXrV5taNgLo2q+Znw+THbCjzaTX5ctmHwsF7DyKrp7nafz5HnvD5CxGk1+g=="}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:01.408969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-ce8e5beb-4d72-4eac-801f-c0bd0ae6fea6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Getting quotas for project bf99d88fec9046608e464a5e2c75506e. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:39:01.419419 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-ce8e5beb-4d72-4eac-801f-c0bd0ae6fea6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Getting quotas for user 9a0e96324450438699abfcefec6d1a6d and project bf99d88fec9046608e464a5e2c75506e. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:39:01.577065 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ce8e5beb-4d72-4eac-801f-c0bd0ae6fea6 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.238096 May 26 19:39:01.582664 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 117/234] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:39:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:02.727694 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-625dd60f-c476-4930-abec-68535b955e4b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Action: 'create', calling method: .version_select at 0x7fa78848f4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1830455866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAidOs235kNKXbrvyh9HjlFUPG440ct4C1ACQuIIPS2B+Xzn8TCFMSZKIJLy8ca+0Mzu2vgBucLMmrlSBEkFb9Gk/r9IhbknJYROuuERy/n0qQ/jymU923I4DF77TUg+Zw=="}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:02.737197 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:02.747313 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-625dd60f-c476-4930-abec-68535b955e4b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Getting quotas for project dabc38fc95184250b1d9e7090ab73b2c. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:39:02.752294 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-625dd60f-c476-4930-abec-68535b955e4b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Getting quotas for user fe347ddb98df4018b1b9d65db314d8d8 and project dabc38fc95184250b1d9e7090ab73b2c. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:39:02.907767 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-625dd60f-c476-4930-abec-68535b955e4b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.414173 May 26 19:39:02.908435 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 118/235] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:39:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:04.717143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1055020244", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de8e5bc4-ae32-4144-a7c5-8bfa7df1b65d"}], "security_groups": [{"name": "tempest-securitygroup--2013642474"}], "key_name": "tempest-keypair-1981778791", "user_data": "}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:04.744292 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:04.863859 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] validate_networks() for [('de8e5bc4-ae32-4144-a7c5-8bfa7df1b65d', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:39:05.501904 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:39:05.502327 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:39:05.502800 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:39:05.503244 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:39:05.503650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:39:05.513145 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:05.513594 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:05.514380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:05.514837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:05.533119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Getting quotas for project bf99d88fec9046608e464a5e2c75506e. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:39:05.537803 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Getting quotas for user 9a0e96324450438699abfcefec6d1a6d and project bf99d88fec9046608e464a5e2c75506e. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:39:05.550379 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:39:05.552712 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:39:05.767531 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-316f0b3c-c28c-4374-a205-e4e18de144ef tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.055281 May 26 19:39:05.768748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 118/236] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:39:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:39:05.790659 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5f22019d-36b1-4d67-a5ab-f8364c109570 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:05.794477 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5f22019d-36b1-4d67-a5ab-f8364c109570 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:05.887451 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5f22019d-36b1-4d67-a5ab-f8364c109570 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:05.900209 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5f22019d-36b1-4d67-a5ab-f8364c109570 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1246 microversion: 2.1 time: 0.125411 May 26 19:39:05.900792 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 119/237] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:05 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:06.921677 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7d1ee92c-c374-43ff-b610-fc904ff2c6c7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:06.927675 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7d1ee92c-c374-43ff-b610-fc904ff2c6c7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:06.946999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7d1ee92c-c374-43ff-b610-fc904ff2c6c7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:06.947851 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7d1ee92c-c374-43ff-b610-fc904ff2c6c7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:06.948682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7d1ee92c-c374-43ff-b610-fc904ff2c6c7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:06.959521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7d1ee92c-c374-43ff-b610-fc904ff2c6c7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:06.993370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-158abbd0-a266-4564-bbf3-074ab303987f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: .version_select at 0x7fa789cfdee0>, body: {"keypair": {"name": "tempest-keypair-1162214640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDbO5eNB2yzZdZr3B+hyu8LxYG3SZHoPRvE6Xrm/uZ+OSh75vtrqYw8WXnxI1r6zvTX1k6X4RLs4kvCIM6HavMUDxar7lhIfjwfcD/oorsOqloZu19+F1tD0bU+b2jaEQ=="}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:07.023177 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-158abbd0-a266-4564-bbf3-074ab303987f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:39:07.038483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-158abbd0-a266-4564-bbf3-074ab303987f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for user 841abe37b81f47d2a95140e46b12ea08 and project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:39:07.085218 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7d1ee92c-c374-43ff-b610-fc904ff2c6c7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:07.094438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7d1ee92c-c374-43ff-b610-fc904ff2c6c7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1250 microversion: 2.1 time: 0.181022 May 26 19:39:07.099972 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 119/238] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:06 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1250 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:07.190409 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-158abbd0-a266-4564-bbf3-074ab303987f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.202106 May 26 19:39:07.191544 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 120/239] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:39:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:08.116964 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d7f05b4b-5c14-4d4d-81a2-d1bd24aa84be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:08.117724 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d7f05b4b-5c14-4d4d-81a2-d1bd24aa84be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:08.125257 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7f05b4b-5c14-4d4d-81a2-d1bd24aa84be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:08.125724 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7f05b4b-5c14-4d4d-81a2-d1bd24aa84be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:08.126723 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7f05b4b-5c14-4d4d-81a2-d1bd24aa84be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:08.127351 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7f05b4b-5c14-4d4d-81a2-d1bd24aa84be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:08.188963 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d7f05b4b-5c14-4d4d-81a2-d1bd24aa84be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:08.196387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d7f05b4b-5c14-4d4d-81a2-d1bd24aa84be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1298 microversion: 2.1 time: 0.084484 May 26 19:39:08.201977 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 120/240] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:08 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:09.216598 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6d2836e2-4e0f-4047-bce9-9b9780408baa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:09.217203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6d2836e2-4e0f-4047-bce9-9b9780408baa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:09.219603 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:09.225188 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d2836e2-4e0f-4047-bce9-9b9780408baa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:09.225684 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d2836e2-4e0f-4047-bce9-9b9780408baa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:09.226686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d2836e2-4e0f-4047-bce9-9b9780408baa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:09.227045 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d2836e2-4e0f-4047-bce9-9b9780408baa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:09.423311 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6d2836e2-4e0f-4047-bce9-9b9780408baa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:09.430931 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6d2836e2-4e0f-4047-bce9-9b9780408baa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.218099 May 26 19:39:09.431875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 121/241] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:09 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:09.952882 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-323404481", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ddf1778-5518-469d-acdc-1047098dc517"}], "security_groups": [{"name": "tempest-securitygroup--300339762"}], "key_name": "tempest-keypair-1162214640", "user_data": "}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:10.448836 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-96e68d41-749a-4e75-9357-589b2ff1794d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:10.449450 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-96e68d41-749a-4e75-9357-589b2ff1794d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:10.459575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-96e68d41-749a-4e75-9357-589b2ff1794d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:10.460193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-96e68d41-749a-4e75-9357-589b2ff1794d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:10.461212 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-96e68d41-749a-4e75-9357-589b2ff1794d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:10.461796 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-96e68d41-749a-4e75-9357-589b2ff1794d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:10.594226 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-96e68d41-749a-4e75-9357-589b2ff1794d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:10.601604 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-96e68d41-749a-4e75-9357-589b2ff1794d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.156690 May 26 19:39:10.602179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 122/242] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:10 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:11.620644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5c2c9f3b-5c9e-49bb-8e24-a526facee54d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:11.621286 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5c2c9f3b-5c9e-49bb-8e24-a526facee54d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:11.628647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c2c9f3b-5c9e-49bb-8e24-a526facee54d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:11.629097 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c2c9f3b-5c9e-49bb-8e24-a526facee54d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:11.629858 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c2c9f3b-5c9e-49bb-8e24-a526facee54d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:11.630293 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c2c9f3b-5c9e-49bb-8e24-a526facee54d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:11.759231 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5c2c9f3b-5c9e-49bb-8e24-a526facee54d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:11.766655 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5c2c9f3b-5c9e-49bb-8e24-a526facee54d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.150381 May 26 19:39:11.767329 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 123/243] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:11 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:12.784578 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-782044fe-cf9b-4e7b-93b0-9a84a1364825 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:12.785158 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-782044fe-cf9b-4e7b-93b0-9a84a1364825 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:12.791563 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-782044fe-cf9b-4e7b-93b0-9a84a1364825 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:12.792008 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-782044fe-cf9b-4e7b-93b0-9a84a1364825 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:12.792762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-782044fe-cf9b-4e7b-93b0-9a84a1364825 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:12.793194 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-782044fe-cf9b-4e7b-93b0-9a84a1364825 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:12.932579 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-782044fe-cf9b-4e7b-93b0-9a84a1364825 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:12.942732 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-782044fe-cf9b-4e7b-93b0-9a84a1364825 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.162969 May 26 19:39:12.944783 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 124/244] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:12 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:12.952389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-ca9e43d9-4f3f-44fd-a397-e1cff78f885d req-962df38b-7dad-4d83-9e85-be2672e6bfa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19b79e3-ce41-4806-b97f-8a14cd797d63", "tag": "e6b42048-c3ab-4c39-bdb2-eab21f5b42e7"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:12.963113 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ca9e43d9-4f3f-44fd-a397-e1cff78f885d req-962df38b-7dad-4d83-9e85-be2672e6bfa3 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:12.963576 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ca9e43d9-4f3f-44fd-a397-e1cff78f885d req-962df38b-7dad-4d83-9e85-be2672e6bfa3 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:12.975861 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-ca9e43d9-4f3f-44fd-a397-e1cff78f885d req-962df38b-7dad-4d83-9e85-be2672e6bfa3 service nova] Creating event network-changed:e6b42048-c3ab-4c39-bdb2-eab21f5b42e7 for instance d19b79e3-ce41-4806-b97f-8a14cd797d63 on hv-cinder-82549 May 26 19:39:12.981303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-ca9e43d9-4f3f-44fd-a397-e1cff78f885d req-962df38b-7dad-4d83-9e85-be2672e6bfa3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036406 May 26 19:39:12.982214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 125/245] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:13.960644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-01738de4-06e2-4b4b-9cc5-300ff3c0fe7d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:13.961346 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-01738de4-06e2-4b4b-9cc5-300ff3c0fe7d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:13.968135 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01738de4-06e2-4b4b-9cc5-300ff3c0fe7d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:13.968587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01738de4-06e2-4b4b-9cc5-300ff3c0fe7d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:13.969354 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01738de4-06e2-4b4b-9cc5-300ff3c0fe7d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:13.969833 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01738de4-06e2-4b4b-9cc5-300ff3c0fe7d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:14.109838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-01738de4-06e2-4b4b-9cc5-300ff3c0fe7d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:14.117611 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-01738de4-06e2-4b4b-9cc5-300ff3c0fe7d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.161308 May 26 19:39:14.118116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 126/246] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:13 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:15.135001 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ab478433-33de-4709-93e2-1949815ec189 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:15.135661 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ab478433-33de-4709-93e2-1949815ec189 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:15.142871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab478433-33de-4709-93e2-1949815ec189 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:15.143346 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab478433-33de-4709-93e2-1949815ec189 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:15.144109 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab478433-33de-4709-93e2-1949815ec189 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:15.144739 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab478433-33de-4709-93e2-1949815ec189 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:15.276098 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ab478433-33de-4709-93e2-1949815ec189 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:15.284424 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ab478433-33de-4709-93e2-1949815ec189 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.153303 May 26 19:39:15.284994 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 127/247] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:15 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:15.524266 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:15.544455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=10 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:16.301631 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-22d0dd67-d0a6-4c15-ae1d-aae0e68d9af2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:16.302234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-22d0dd67-d0a6-4c15-ae1d-aae0e68d9af2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:16.308921 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22d0dd67-d0a6-4c15-ae1d-aae0e68d9af2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:16.309381 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22d0dd67-d0a6-4c15-ae1d-aae0e68d9af2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:16.310166 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22d0dd67-d0a6-4c15-ae1d-aae0e68d9af2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:16.310609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22d0dd67-d0a6-4c15-ae1d-aae0e68d9af2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:16.453736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-22d0dd67-d0a6-4c15-ae1d-aae0e68d9af2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:16.464093 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-22d0dd67-d0a6-4c15-ae1d-aae0e68d9af2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.166741 May 26 19:39:16.464677 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 128/248] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:16 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:17.085240 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] validate_networks() for [('2ddf1778-5518-469d-acdc-1047098dc517', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:39:17.446354 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:39:17.446779 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:39:17.447293 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:39:17.447698 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:39:17.448109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:39:17.457323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:17.457766 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:17.458563 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:17.459045 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:17.477212 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:39:17.481057 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b0e1e0e3-2eca-4251-a405-f2e6e9547f31 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:17.481534 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for user 841abe37b81f47d2a95140e46b12ea08 and project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:39:17.481768 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b0e1e0e3-2eca-4251-a405-f2e6e9547f31 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:17.484667 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=10 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:17.489122 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b0e1e0e3-2eca-4251-a405-f2e6e9547f31 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:17.489563 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b0e1e0e3-2eca-4251-a405-f2e6e9547f31 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:17.490313 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b0e1e0e3-2eca-4251-a405-f2e6e9547f31 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:17.491000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b0e1e0e3-2eca-4251-a405-f2e6e9547f31 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:17.493354 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:39:17.499668 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:39:17.622856 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b0e1e0e3-2eca-4251-a405-f2e6e9547f31 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:17.630314 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b0e1e0e3-2eca-4251-a405-f2e6e9547f31 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.152976 May 26 19:39:17.630875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 129/249] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:17 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:17.657208 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-78c2e4d0-304f-47ad-997e-adcdd4d1239c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.709133 May 26 19:39:17.657887 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 121/250] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:39:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 7711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:39:17.668491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c07ec79f-080b-4bdb-9b68-b9a48eb011f0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:17.669091 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c07ec79f-080b-4bdb-9b68-b9a48eb011f0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:17.721452 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c07ec79f-080b-4bdb-9b68-b9a48eb011f0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:17.728047 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c07ec79f-080b-4bdb-9b68-b9a48eb011f0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1241 microversion: 2.1 time: 0.063359 May 26 19:39:17.728612 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 130/251] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:17 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:18.647091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-21e5125f-08be-4e70-accf-7db5ae1a6a38 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:18.647843 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-21e5125f-08be-4e70-accf-7db5ae1a6a38 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:18.654542 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-21e5125f-08be-4e70-accf-7db5ae1a6a38 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:18.655038 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-21e5125f-08be-4e70-accf-7db5ae1a6a38 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:18.655806 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-21e5125f-08be-4e70-accf-7db5ae1a6a38 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:18.656248 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-21e5125f-08be-4e70-accf-7db5ae1a6a38 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:18.745439 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f5ddd497-c5f5-4c7e-8da3-602b351e1f13 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:18.746073 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f5ddd497-c5f5-4c7e-8da3-602b351e1f13 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:18.752584 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5ddd497-c5f5-4c7e-8da3-602b351e1f13 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:18.753033 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5ddd497-c5f5-4c7e-8da3-602b351e1f13 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:18.753796 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5ddd497-c5f5-4c7e-8da3-602b351e1f13 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:18.754225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5ddd497-c5f5-4c7e-8da3-602b351e1f13 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:18.787724 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-21e5125f-08be-4e70-accf-7db5ae1a6a38 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:18.795531 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-21e5125f-08be-4e70-accf-7db5ae1a6a38 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.152421 May 26 19:39:18.796114 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 122/252] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:18 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:18.815026 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f5ddd497-c5f5-4c7e-8da3-602b351e1f13 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:18.822308 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f5ddd497-c5f5-4c7e-8da3-602b351e1f13 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1245 microversion: 2.1 time: 0.080940 May 26 19:39:18.822871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 131/253] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:18 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:19.813296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7ef293f7-7b65-4e0e-8f58-1b136ec367af tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:19.813902 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7ef293f7-7b65-4e0e-8f58-1b136ec367af tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:19.820624 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7ef293f7-7b65-4e0e-8f58-1b136ec367af tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:19.821078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7ef293f7-7b65-4e0e-8f58-1b136ec367af tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:19.821833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7ef293f7-7b65-4e0e-8f58-1b136ec367af tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:19.822271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7ef293f7-7b65-4e0e-8f58-1b136ec367af tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:19.839130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e713ca70-ad92-48f2-ba6d-afd6349832e8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:19.839733 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e713ca70-ad92-48f2-ba6d-afd6349832e8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:19.846367 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e713ca70-ad92-48f2-ba6d-afd6349832e8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:19.847436 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e713ca70-ad92-48f2-ba6d-afd6349832e8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:19.848203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e713ca70-ad92-48f2-ba6d-afd6349832e8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:19.848639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e713ca70-ad92-48f2-ba6d-afd6349832e8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:19.914161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e713ca70-ad92-48f2-ba6d-afd6349832e8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:19.920167 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e713ca70-ad92-48f2-ba6d-afd6349832e8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1237 microversion: 2.1 time: 0.084897 May 26 19:39:19.920791 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 132/254] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:19 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:19.962608 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7ef293f7-7b65-4e0e-8f58-1b136ec367af tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:19.970051 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7ef293f7-7b65-4e0e-8f58-1b136ec367af tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.160711 May 26 19:39:19.970640 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 123/255] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:19 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:20.938002 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c76e1756-2d73-41b3-88f6-d5166c85d2d7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:20.939370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c76e1756-2d73-41b3-88f6-d5166c85d2d7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:20.946233 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c76e1756-2d73-41b3-88f6-d5166c85d2d7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:20.946673 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c76e1756-2d73-41b3-88f6-d5166c85d2d7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:20.947534 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c76e1756-2d73-41b3-88f6-d5166c85d2d7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:20.947963 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c76e1756-2d73-41b3-88f6-d5166c85d2d7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:20.989169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-288e87d6-8b6a-444b-b912-f4041ba8899c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:20.989754 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-288e87d6-8b6a-444b-b912-f4041ba8899c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:20.996677 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-288e87d6-8b6a-444b-b912-f4041ba8899c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:20.997297 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-288e87d6-8b6a-444b-b912-f4041ba8899c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:20.998180 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-288e87d6-8b6a-444b-b912-f4041ba8899c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:20.998748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-288e87d6-8b6a-444b-b912-f4041ba8899c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:21.012264 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c76e1756-2d73-41b3-88f6-d5166c85d2d7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:21.019861 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c76e1756-2d73-41b3-88f6-d5166c85d2d7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1293 microversion: 2.1 time: 0.086378 May 26 19:39:21.020503 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 133/256] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:20 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:21.133326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-288e87d6-8b6a-444b-b912-f4041ba8899c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:21.140835 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-288e87d6-8b6a-444b-b912-f4041ba8899c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.156990 May 26 19:39:21.141403 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 124/257] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:20 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:22.037334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-952e40b1-79aa-41cb-8c18-d32a48baa8e2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:22.038825 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-952e40b1-79aa-41cb-8c18-d32a48baa8e2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:22.046629 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-952e40b1-79aa-41cb-8c18-d32a48baa8e2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:22.046629 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-952e40b1-79aa-41cb-8c18-d32a48baa8e2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:22.046868 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-952e40b1-79aa-41cb-8c18-d32a48baa8e2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:22.047323 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-952e40b1-79aa-41cb-8c18-d32a48baa8e2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:22.129763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-952e40b1-79aa-41cb-8c18-d32a48baa8e2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:22.147541 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-952e40b1-79aa-41cb-8c18-d32a48baa8e2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1299 microversion: 2.1 time: 0.113585 May 26 19:39:22.148916 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 134/258] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:22 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:22.160558 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-81cf0e9c-6dcd-43a0-bf07-4ef293164d5c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:22.162285 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-81cf0e9c-6dcd-43a0-bf07-4ef293164d5c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:22.172168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81cf0e9c-6dcd-43a0-bf07-4ef293164d5c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:22.172909 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81cf0e9c-6dcd-43a0-bf07-4ef293164d5c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:22.173707 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81cf0e9c-6dcd-43a0-bf07-4ef293164d5c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:22.174144 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81cf0e9c-6dcd-43a0-bf07-4ef293164d5c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:22.363967 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-81cf0e9c-6dcd-43a0-bf07-4ef293164d5c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:22.381793 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-81cf0e9c-6dcd-43a0-bf07-4ef293164d5c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.226976 May 26 19:39:22.401710 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 125/259] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:22 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:23.166078 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0e4fe3ff-318d-411f-be56-0cd6a787a64e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:23.166808 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0e4fe3ff-318d-411f-be56-0cd6a787a64e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:23.173464 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0e4fe3ff-318d-411f-be56-0cd6a787a64e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:23.173839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0e4fe3ff-318d-411f-be56-0cd6a787a64e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:23.174933 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0e4fe3ff-318d-411f-be56-0cd6a787a64e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:23.175107 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0e4fe3ff-318d-411f-be56-0cd6a787a64e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:23.307720 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0e4fe3ff-318d-411f-be56-0cd6a787a64e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:23.315961 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0e4fe3ff-318d-411f-be56-0cd6a787a64e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.153244 May 26 19:39:23.316412 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 135/260] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:23 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:23.409510 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-16bea667-86f1-44d7-82dd-82966e336c26 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:23.410161 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-16bea667-86f1-44d7-82dd-82966e336c26 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:23.418277 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-16bea667-86f1-44d7-82dd-82966e336c26 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:23.418496 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-cd0fc132-2654-4f72-a300-a93bfba18744 req-6afa6ecb-a9ee-4df5-a9e7-615345c8836e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52eb678d-5cbe-4e95-914d-09d3165544f3", "tag": "e87f31d0-2caa-4fb2-aa27-5c69f8daae4e"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:23.419252 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-16bea667-86f1-44d7-82dd-82966e336c26 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:23.420241 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-16bea667-86f1-44d7-82dd-82966e336c26 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:23.421076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-16bea667-86f1-44d7-82dd-82966e336c26 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:23.431435 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-cd0fc132-2654-4f72-a300-a93bfba18744 req-6afa6ecb-a9ee-4df5-a9e7-615345c8836e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:23.431829 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-cd0fc132-2654-4f72-a300-a93bfba18744 req-6afa6ecb-a9ee-4df5-a9e7-615345c8836e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:23.450021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-cd0fc132-2654-4f72-a300-a93bfba18744 req-6afa6ecb-a9ee-4df5-a9e7-615345c8836e service nova] Creating event network-changed:e87f31d0-2caa-4fb2-aa27-5c69f8daae4e for instance 52eb678d-5cbe-4e95-914d-09d3165544f3 on hv-cinder-82549 May 26 19:39:23.455020 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-cd0fc132-2654-4f72-a300-a93bfba18744 req-6afa6ecb-a9ee-4df5-a9e7-615345c8836e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045909 May 26 19:39:23.455649 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 136/261] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:39:23.569707 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-16bea667-86f1-44d7-82dd-82966e336c26 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:23.577978 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-16bea667-86f1-44d7-82dd-82966e336c26 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.172884 May 26 19:39:23.578568 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 126/262] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:23 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:24.333725 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6a1ffe09-79d7-4c3e-8872-0882f596dbf4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:24.334408 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6a1ffe09-79d7-4c3e-8872-0882f596dbf4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:24.340726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe09-79d7-4c3e-8872-0882f596dbf4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:24.341161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe09-79d7-4c3e-8872-0882f596dbf4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:24.341903 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe09-79d7-4c3e-8872-0882f596dbf4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:24.342331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe09-79d7-4c3e-8872-0882f596dbf4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:24.472878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6a1ffe09-79d7-4c3e-8872-0882f596dbf4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:24.480179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6a1ffe09-79d7-4c3e-8872-0882f596dbf4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.151625 May 26 19:39:24.480743 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 137/263] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:24 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:24.595653 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3f3c6c73-ab00-4bf0-bf53-85aa453f6b33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:24.596250 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3f3c6c73-ab00-4bf0-bf53-85aa453f6b33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:24.602866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3f3c6c73-ab00-4bf0-bf53-85aa453f6b33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:24.603414 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3f3c6c73-ab00-4bf0-bf53-85aa453f6b33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:24.604167 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3f3c6c73-ab00-4bf0-bf53-85aa453f6b33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:24.604597 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3f3c6c73-ab00-4bf0-bf53-85aa453f6b33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:24.748513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3f3c6c73-ab00-4bf0-bf53-85aa453f6b33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:24.757054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3f3c6c73-ab00-4bf0-bf53-85aa453f6b33 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.165840 May 26 19:39:24.758005 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 127/264] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:24 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:25.497363 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-bac3c166-15ac-4131-a41a-d30c8d34d90a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:25.497966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-bac3c166-15ac-4131-a41a-d30c8d34d90a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:25.504502 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bac3c166-15ac-4131-a41a-d30c8d34d90a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:25.504948 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bac3c166-15ac-4131-a41a-d30c8d34d90a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:25.505702 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bac3c166-15ac-4131-a41a-d30c8d34d90a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:25.506135 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bac3c166-15ac-4131-a41a-d30c8d34d90a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:25.629533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-bac3c166-15ac-4131-a41a-d30c8d34d90a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:25.636941 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-bac3c166-15ac-4131-a41a-d30c8d34d90a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.143505 May 26 19:39:25.637505 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 138/265] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:25 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:25.774028 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5fb055dd-f698-450d-a18c-4e0e56b7f135 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:25.774676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5fb055dd-f698-450d-a18c-4e0e56b7f135 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:25.781256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5fb055dd-f698-450d-a18c-4e0e56b7f135 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:25.782027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5fb055dd-f698-450d-a18c-4e0e56b7f135 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:25.782790 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5fb055dd-f698-450d-a18c-4e0e56b7f135 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:25.783253 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5fb055dd-f698-450d-a18c-4e0e56b7f135 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:25.923294 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5fb055dd-f698-450d-a18c-4e0e56b7f135 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:25.932449 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5fb055dd-f698-450d-a18c-4e0e56b7f135 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.162245 May 26 19:39:25.933027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 128/266] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:25 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:26.654023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a9043583-2a0f-4d99-8307-14a1a2944990 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:26.654892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a9043583-2a0f-4d99-8307-14a1a2944990 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:26.662164 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a9043583-2a0f-4d99-8307-14a1a2944990 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:26.662443 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a9043583-2a0f-4d99-8307-14a1a2944990 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:26.663278 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a9043583-2a0f-4d99-8307-14a1a2944990 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:26.663779 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a9043583-2a0f-4d99-8307-14a1a2944990 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:26.803109 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a9043583-2a0f-4d99-8307-14a1a2944990 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:26.806739 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=100 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:26.811407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a9043583-2a0f-4d99-8307-14a1a2944990 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.161190 May 26 19:39:26.811984 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 139/267] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:26 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:26.949162 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2ed0a8d4-ee6d-4e34-af09-e9f928016b10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:26.949774 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2ed0a8d4-ee6d-4e34-af09-e9f928016b10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:26.956514 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ed0a8d4-ee6d-4e34-af09-e9f928016b10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:26.957213 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ed0a8d4-ee6d-4e34-af09-e9f928016b10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:26.958150 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ed0a8d4-ee6d-4e34-af09-e9f928016b10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:26.958468 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ed0a8d4-ee6d-4e34-af09-e9f928016b10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:27.208294 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2ed0a8d4-ee6d-4e34-af09-e9f928016b10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:27.211655 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=76 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:27.218774 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-bbb6ce57-7ecf-4f1d-9347-b5707d78eeb8 req-13d6f9d4-05ad-48d3-9a0c-3be464fff782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19b79e3-ce41-4806-b97f-8a14cd797d63", "name": "network-vif-plugged", "status": "completed", "tag": "e6b42048-c3ab-4c39-bdb2-eab21f5b42e7"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:27.229897 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2ed0a8d4-ee6d-4e34-af09-e9f928016b10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.284367 May 26 19:39:27.230477 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 129/268] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:26 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:27.237852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-bbb6ce57-7ecf-4f1d-9347-b5707d78eeb8 req-13d6f9d4-05ad-48d3-9a0c-3be464fff782 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:27.238292 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-bbb6ce57-7ecf-4f1d-9347-b5707d78eeb8 req-13d6f9d4-05ad-48d3-9a0c-3be464fff782 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:27.250729 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-bbb6ce57-7ecf-4f1d-9347-b5707d78eeb8 req-13d6f9d4-05ad-48d3-9a0c-3be464fff782 service nova] Creating event network-vif-plugged:e6b42048-c3ab-4c39-bdb2-eab21f5b42e7 for instance d19b79e3-ce41-4806-b97f-8a14cd797d63 on hv-cinder-82549 May 26 19:39:27.256489 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-bbb6ce57-7ecf-4f1d-9347-b5707d78eeb8 req-13d6f9d4-05ad-48d3-9a0c-3be464fff782 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041867 May 26 19:39:27.257217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 140/269] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:39:27.828579 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d07ba318-06c4-4ba6-b7a6-d42939c50c5a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:27.829056 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d07ba318-06c4-4ba6-b7a6-d42939c50c5a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:27.831270 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:27.831943 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=6 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:27.837867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d07ba318-06c4-4ba6-b7a6-d42939c50c5a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:27.838322 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d07ba318-06c4-4ba6-b7a6-d42939c50c5a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:27.839127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d07ba318-06c4-4ba6-b7a6-d42939c50c5a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:27.839569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d07ba318-06c4-4ba6-b7a6-d42939c50c5a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:27.977347 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d07ba318-06c4-4ba6-b7a6-d42939c50c5a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:27.985364 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d07ba318-06c4-4ba6-b7a6-d42939c50c5a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.160801 May 26 19:39:27.985869 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 130/270] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:27 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:28.245486 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:28.249224 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-fdc2744b-1a58-4d05-bbbd-37e29033f7f5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:28.249918 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-fdc2744b-1a58-4d05-bbbd-37e29033f7f5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:28.255982 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fdc2744b-1a58-4d05-bbbd-37e29033f7f5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:28.256427 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fdc2744b-1a58-4d05-bbbd-37e29033f7f5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:28.257181 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fdc2744b-1a58-4d05-bbbd-37e29033f7f5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:28.257677 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fdc2744b-1a58-4d05-bbbd-37e29033f7f5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:28.390635 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-fdc2744b-1a58-4d05-bbbd-37e29033f7f5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:28.398592 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-fdc2744b-1a58-4d05-bbbd-37e29033f7f5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.155074 May 26 19:39:28.400982 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 141/271] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:28 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:29.003712 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b86c62d4-2e83-4858-a574-9c26397ec5eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:29.004496 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b86c62d4-2e83-4858-a574-9c26397ec5eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:29.011934 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b86c62d4-2e83-4858-a574-9c26397ec5eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:29.012435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b86c62d4-2e83-4858-a574-9c26397ec5eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:29.013214 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b86c62d4-2e83-4858-a574-9c26397ec5eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:29.013630 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b86c62d4-2e83-4858-a574-9c26397ec5eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:29.161842 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b86c62d4-2e83-4858-a574-9c26397ec5eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:29.169356 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b86c62d4-2e83-4858-a574-9c26397ec5eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.169503 May 26 19:39:29.169941 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 131/272] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:28 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:29.416011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3b41760d-63da-42be-a3b3-1f3c792cc0f7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:29.416609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3b41760d-63da-42be-a3b3-1f3c792cc0f7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:29.423732 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b41760d-63da-42be-a3b3-1f3c792cc0f7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:29.428827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b41760d-63da-42be-a3b3-1f3c792cc0f7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:29.428827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b41760d-63da-42be-a3b3-1f3c792cc0f7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:29.428827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b41760d-63da-42be-a3b3-1f3c792cc0f7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:29.560378 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3b41760d-63da-42be-a3b3-1f3c792cc0f7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:29.567871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3b41760d-63da-42be-a3b3-1f3c792cc0f7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.155740 May 26 19:39:29.569040 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 142/273] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:29 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:30.185608 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fbcc99d7-da26-406a-9eb8-c5b2ef5f7505 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:30.186219 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fbcc99d7-da26-406a-9eb8-c5b2ef5f7505 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:30.198015 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fbcc99d7-da26-406a-9eb8-c5b2ef5f7505 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:30.198015 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fbcc99d7-da26-406a-9eb8-c5b2ef5f7505 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:30.198015 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fbcc99d7-da26-406a-9eb8-c5b2ef5f7505 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:30.198015 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fbcc99d7-da26-406a-9eb8-c5b2ef5f7505 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:30.325127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fbcc99d7-da26-406a-9eb8-c5b2ef5f7505 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:30.332555 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fbcc99d7-da26-406a-9eb8-c5b2ef5f7505 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.150858 May 26 19:39:30.333129 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 132/274] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:30 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:30.585822 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1da5492c-a64c-4c51-9ffc-e6b2b5bf53b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:30.587250 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1da5492c-a64c-4c51-9ffc-e6b2b5bf53b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:30.593236 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1da5492c-a64c-4c51-9ffc-e6b2b5bf53b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:30.593683 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1da5492c-a64c-4c51-9ffc-e6b2b5bf53b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:30.594440 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1da5492c-a64c-4c51-9ffc-e6b2b5bf53b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:30.594872 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1da5492c-a64c-4c51-9ffc-e6b2b5bf53b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:30.721876 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1da5492c-a64c-4c51-9ffc-e6b2b5bf53b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:30.729366 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1da5492c-a64c-4c51-9ffc-e6b2b5bf53b4 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.148017 May 26 19:39:30.729929 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 143/275] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:30 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:31.350283 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-571dbb64-2836-4f82-87c6-9e4a264438cf tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:31.350891 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-571dbb64-2836-4f82-87c6-9e4a264438cf tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:31.357409 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-571dbb64-2836-4f82-87c6-9e4a264438cf tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:31.357861 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-571dbb64-2836-4f82-87c6-9e4a264438cf tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:31.358623 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-571dbb64-2836-4f82-87c6-9e4a264438cf tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:31.359090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-571dbb64-2836-4f82-87c6-9e4a264438cf tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:31.488122 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-571dbb64-2836-4f82-87c6-9e4a264438cf tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:31.496447 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-571dbb64-2836-4f82-87c6-9e4a264438cf tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.150542 May 26 19:39:31.497023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 133/276] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:31 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:31.746005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-fc5a418e-80c0-4b6d-8116-71c8eaf24cdf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:31.746513 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-fc5a418e-80c0-4b6d-8116-71c8eaf24cdf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:31.752962 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fc5a418e-80c0-4b6d-8116-71c8eaf24cdf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:31.753402 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fc5a418e-80c0-4b6d-8116-71c8eaf24cdf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:31.754149 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fc5a418e-80c0-4b6d-8116-71c8eaf24cdf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:31.754576 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fc5a418e-80c0-4b6d-8116-71c8eaf24cdf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:31.881391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-fc5a418e-80c0-4b6d-8116-71c8eaf24cdf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:31.888817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-fc5a418e-80c0-4b6d-8116-71c8eaf24cdf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.146825 May 26 19:39:31.889379 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 144/277] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:31 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:32.512923 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8c0ce289-b933-47d0-be98-b04832f01e63 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:32.513443 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8c0ce289-b933-47d0-be98-b04832f01e63 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:32.519907 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8c0ce289-b933-47d0-be98-b04832f01e63 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:32.520355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8c0ce289-b933-47d0-be98-b04832f01e63 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:32.521143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8c0ce289-b933-47d0-be98-b04832f01e63 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:32.521583 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8c0ce289-b933-47d0-be98-b04832f01e63 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:32.647370 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8c0ce289-b933-47d0-be98-b04832f01e63 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:32.654700 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8c0ce289-b933-47d0-be98-b04832f01e63 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.145714 May 26 19:39:32.655291 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 134/278] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:32 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:32.905886 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9e83188c-67b0-493b-a5eb-ee1ced26571e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:32.906493 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9e83188c-67b0-493b-a5eb-ee1ced26571e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:32.913519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9e83188c-67b0-493b-a5eb-ee1ced26571e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:32.913971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9e83188c-67b0-493b-a5eb-ee1ced26571e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:32.918562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9e83188c-67b0-493b-a5eb-ee1ced26571e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:32.918562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9e83188c-67b0-493b-a5eb-ee1ced26571e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:33.044577 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9e83188c-67b0-493b-a5eb-ee1ced26571e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:33.052033 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9e83188c-67b0-493b-a5eb-ee1ced26571e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1372 microversion: 2.1 time: 0.149962 May 26 19:39:33.053193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 145/279] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:32 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:33.672115 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e1048c8c-6697-4726-857d-33b765bc9c35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:33.672721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e1048c8c-6697-4726-857d-33b765bc9c35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:33.679877 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e1048c8c-6697-4726-857d-33b765bc9c35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:33.680326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e1048c8c-6697-4726-857d-33b765bc9c35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:33.681083 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e1048c8c-6697-4726-857d-33b765bc9c35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:33.681517 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e1048c8c-6697-4726-857d-33b765bc9c35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:33.818537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e1048c8c-6697-4726-857d-33b765bc9c35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:33.820438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e1048c8c-6697-4726-857d-33b765bc9c35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.152272 May 26 19:39:33.821026 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 135/280] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:33 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:33.958135 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-3d57a1b0-6929-4da4-abff-7c9b57363056 req-33208bc1-73ee-435a-a496-0071ec09cb4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52eb678d-5cbe-4e95-914d-09d3165544f3", "name": "network-vif-plugged", "status": "completed", "tag": "e87f31d0-2caa-4fb2-aa27-5c69f8daae4e"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:33.967289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-3d57a1b0-6929-4da4-abff-7c9b57363056 req-33208bc1-73ee-435a-a496-0071ec09cb4f service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:33.967736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-3d57a1b0-6929-4da4-abff-7c9b57363056 req-33208bc1-73ee-435a-a496-0071ec09cb4f service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:33.981050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-3d57a1b0-6929-4da4-abff-7c9b57363056 req-33208bc1-73ee-435a-a496-0071ec09cb4f service nova] Creating event network-vif-plugged:e87f31d0-2caa-4fb2-aa27-5c69f8daae4e for instance 52eb678d-5cbe-4e95-914d-09d3165544f3 on hv-cinder-82549 May 26 19:39:33.985945 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-3d57a1b0-6929-4da4-abff-7c9b57363056 req-33208bc1-73ee-435a-a496-0071ec09cb4f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031616 May 26 19:39:33.986532 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 146/281] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:34.069506 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-58803f20-bfcf-45fb-be95-bc7dd89bf253 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:34.070072 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-58803f20-bfcf-45fb-be95-bc7dd89bf253 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:34.076564 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58803f20-bfcf-45fb-be95-bc7dd89bf253 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:34.077063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58803f20-bfcf-45fb-be95-bc7dd89bf253 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:34.077918 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58803f20-bfcf-45fb-be95-bc7dd89bf253 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:34.078363 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58803f20-bfcf-45fb-be95-bc7dd89bf253 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:34.210136 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-58803f20-bfcf-45fb-be95-bc7dd89bf253 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:34.217801 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-58803f20-bfcf-45fb-be95-bc7dd89bf253 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1566 microversion: 2.1 time: 0.152328 May 26 19:39:34.218363 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 136/282] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:34 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:34.234693 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-98e41f0b-238d-42e0-90ca-fcbe84709a04 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:34.235309 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-98e41f0b-238d-42e0-90ca-fcbe84709a04 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:34.241660 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-98e41f0b-238d-42e0-90ca-fcbe84709a04 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:34.242106 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-98e41f0b-238d-42e0-90ca-fcbe84709a04 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:34.242861 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-98e41f0b-238d-42e0-90ca-fcbe84709a04 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:34.243318 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-98e41f0b-238d-42e0-90ca-fcbe84709a04 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:34.324115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-98e41f0b-238d-42e0-90ca-fcbe84709a04 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092640 May 26 19:39:34.324115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 147/283] 10.222.0.72 () {58 vars in 1274 bytes} [Thu May 26 19:39:34 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:34.836738 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-72f9646a-9a00-420e-a04f-767895028904 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:34.837413 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-72f9646a-9a00-420e-a04f-767895028904 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:34.843893 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72f9646a-9a00-420e-a04f-767895028904 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:34.844335 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72f9646a-9a00-420e-a04f-767895028904 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:34.845083 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72f9646a-9a00-420e-a04f-767895028904 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:34.845513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72f9646a-9a00-420e-a04f-767895028904 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:34.980241 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-72f9646a-9a00-420e-a04f-767895028904 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:34.987673 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-72f9646a-9a00-420e-a04f-767895028904 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.154934 May 26 19:39:34.988451 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 137/284] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:34 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:35.321303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-3adf2b48-3e90-4db7-bd4f-cc093d70a353 req-9287870f-7dc4-4a08-ba11-b288b6d15694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19b79e3-ce41-4806-b97f-8a14cd797d63", "tag": "e6b42048-c3ab-4c39-bdb2-eab21f5b42e7"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:35.329506 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-3adf2b48-3e90-4db7-bd4f-cc093d70a353 req-9287870f-7dc4-4a08-ba11-b288b6d15694 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:35.330269 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-3adf2b48-3e90-4db7-bd4f-cc093d70a353 req-9287870f-7dc4-4a08-ba11-b288b6d15694 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:35.341331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-3adf2b48-3e90-4db7-bd4f-cc093d70a353 req-9287870f-7dc4-4a08-ba11-b288b6d15694 service nova] Creating event network-changed:e6b42048-c3ab-4c39-bdb2-eab21f5b42e7 for instance d19b79e3-ce41-4806-b97f-8a14cd797d63 on hv-cinder-82549 May 26 19:39:35.346134 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-3adf2b48-3e90-4db7-bd4f-cc093d70a353 req-9287870f-7dc4-4a08-ba11-b288b6d15694 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029035 May 26 19:39:35.346731 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 148/285] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:35.594155 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1766016968", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1830455866", "security_groups": [{"name": "tempest-secgroup-smoke-1989480405"}], "block_device_mapping_v2": [{"uuid": "0e48efb7-5104-43fa-98de-a2faaacc4b64", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "492a2884-9243-465b-939b-ac60c35b4b3f"}]}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:35.729699 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] validate_networks() for [('492a2884-9243-465b-939b-ac60c35b4b3f', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:39:36.006512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-31c90b66-64ce-4dd1-8a08-ba12a6f013e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:36.007504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-31c90b66-64ce-4dd1-8a08-ba12a6f013e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:36.015118 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-31c90b66-64ce-4dd1-8a08-ba12a6f013e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:36.015651 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-31c90b66-64ce-4dd1-8a08-ba12a6f013e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:36.016669 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-31c90b66-64ce-4dd1-8a08-ba12a6f013e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:36.017173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-31c90b66-64ce-4dd1-8a08-ba12a6f013e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:36.160728 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-31c90b66-64ce-4dd1-8a08-ba12a6f013e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:36.166226 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:39:36.166680 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:39:36.167499 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:39:36.167907 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:39:36.168312 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:39:36.170977 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-31c90b66-64ce-4dd1-8a08-ba12a6f013e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1366 microversion: 2.1 time: 0.168975 May 26 19:39:36.171772 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 149/286] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:36 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:36.178510 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:36.179038 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:36.179814 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:36.180529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:36.198141 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Getting quotas for project dabc38fc95184250b1d9e7090ab73b2c. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:39:36.201997 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Getting quotas for user fe347ddb98df4018b1b9d65db314d8d8 and project dabc38fc95184250b1d9e7090ab73b2c. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:39:36.263595 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:39:36.265648 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e48efb7-5104-43fa-98de-a2faaacc4b64',volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:39:36.814351 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bc23c8ce-e458-4817-81b4-b5d145d5910e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.224419 May 26 19:39:36.815039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 138/287] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:39:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:39:36.825827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f203e127-ed78-4910-b658-c06d6819851d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:36.826533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f203e127-ed78-4910-b658-c06d6819851d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:36.879564 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f203e127-ed78-4910-b658-c06d6819851d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:36.886771 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f203e127-ed78-4910-b658-c06d6819851d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1095 microversion: 2.1 time: 0.064870 May 26 19:39:36.887366 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 150/288] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:36 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:37.189013 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-83ed1464-b51e-4b76-aef7-4528a13b3f95 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:37.190003 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-83ed1464-b51e-4b76-aef7-4528a13b3f95 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:37.191943 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:37.196933 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-83ed1464-b51e-4b76-aef7-4528a13b3f95 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:37.197568 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-83ed1464-b51e-4b76-aef7-4528a13b3f95 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:37.198337 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-83ed1464-b51e-4b76-aef7-4528a13b3f95 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:37.198777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-83ed1464-b51e-4b76-aef7-4528a13b3f95 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:37.345071 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-83ed1464-b51e-4b76-aef7-4528a13b3f95 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:37.353150 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-83ed1464-b51e-4b76-aef7-4528a13b3f95 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1556 microversion: 2.1 time: 0.168600 May 26 19:39:37.353717 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 139/289] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:37 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:37.371808 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a01ece1c-0c28-42be-9002-5bd4a1835bc9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:37.371928 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a01ece1c-0c28-42be-9002-5bd4a1835bc9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:37.373799 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:37.379433 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a01ece1c-0c28-42be-9002-5bd4a1835bc9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:37.379869 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a01ece1c-0c28-42be-9002-5bd4a1835bc9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:37.380681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a01ece1c-0c28-42be-9002-5bd4a1835bc9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:37.381108 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a01ece1c-0c28-42be-9002-5bd4a1835bc9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:37.465943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a01ece1c-0c28-42be-9002-5bd4a1835bc9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098651 May 26 19:39:37.466578 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 151/290] 10.222.0.72 () {58 vars in 1274 bytes} [Thu May 26 19:39:37 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:37.903594 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-426a376f-ae13-40dc-a244-a7e2bccdca49 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:37.904296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-426a376f-ae13-40dc-a244-a7e2bccdca49 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:37.965227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-426a376f-ae13-40dc-a244-a7e2bccdca49 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:37.972148 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-426a376f-ae13-40dc-a244-a7e2bccdca49 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1095 microversion: 2.1 time: 0.072368 May 26 19:39:37.972617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 140/291] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:37 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:38.778012 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-9fe33d92-44bc-455d-a65e-4b9f9fbab0e9 req-5bba25ef-9da4-4cc7-9732-1089dced8e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52eb678d-5cbe-4e95-914d-09d3165544f3", "tag": "e87f31d0-2caa-4fb2-aa27-5c69f8daae4e"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:38.788182 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-9fe33d92-44bc-455d-a65e-4b9f9fbab0e9 req-5bba25ef-9da4-4cc7-9732-1089dced8e60 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:38.788812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-9fe33d92-44bc-455d-a65e-4b9f9fbab0e9 req-5bba25ef-9da4-4cc7-9732-1089dced8e60 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:38.801116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-9fe33d92-44bc-455d-a65e-4b9f9fbab0e9 req-5bba25ef-9da4-4cc7-9732-1089dced8e60 service nova] Creating event network-changed:e87f31d0-2caa-4fb2-aa27-5c69f8daae4e for instance 52eb678d-5cbe-4e95-914d-09d3165544f3 on hv-cinder-82549 May 26 19:39:38.807852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-9fe33d92-44bc-455d-a65e-4b9f9fbab0e9 req-5bba25ef-9da4-4cc7-9732-1089dced8e60 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036082 May 26 19:39:38.808459 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 152/292] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:38.988867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-994dae70-c32d-45b2-840d-2f5fe10e0f86 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:38.990369 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-994dae70-c32d-45b2-840d-2f5fe10e0f86 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:38.997709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-994dae70-c32d-45b2-840d-2f5fe10e0f86 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:38.998166 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-994dae70-c32d-45b2-840d-2f5fe10e0f86 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:38.998966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-994dae70-c32d-45b2-840d-2f5fe10e0f86 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:38.999409 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-994dae70-c32d-45b2-840d-2f5fe10e0f86 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:39.065386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-994dae70-c32d-45b2-840d-2f5fe10e0f86 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:39.073056 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-994dae70-c32d-45b2-840d-2f5fe10e0f86 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1193 microversion: 2.1 time: 0.088593 May 26 19:39:39.073631 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 141/293] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:38 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:40.092178 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-caf0c46b-24b3-4516-a082-5ad913814880 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:40.092945 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-caf0c46b-24b3-4516-a082-5ad913814880 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:40.100297 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-caf0c46b-24b3-4516-a082-5ad913814880 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:40.100739 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-caf0c46b-24b3-4516-a082-5ad913814880 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:40.101492 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-caf0c46b-24b3-4516-a082-5ad913814880 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:40.101923 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-caf0c46b-24b3-4516-a082-5ad913814880 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:40.177426 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-caf0c46b-24b3-4516-a082-5ad913814880 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:40.185150 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-caf0c46b-24b3-4516-a082-5ad913814880 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1211 microversion: 2.1 time: 0.097869 May 26 19:39:40.191607 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 153/294] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:40 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:41.204867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-41001e45-a2e7-4c18-9f20-f0dc26a9f458 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:41.205706 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-41001e45-a2e7-4c18-9f20-f0dc26a9f458 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:41.212903 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-41001e45-a2e7-4c18-9f20-f0dc26a9f458 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:41.213488 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-41001e45-a2e7-4c18-9f20-f0dc26a9f458 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:41.214133 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-41001e45-a2e7-4c18-9f20-f0dc26a9f458 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:41.214575 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-41001e45-a2e7-4c18-9f20-f0dc26a9f458 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:41.400332 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-41001e45-a2e7-4c18-9f20-f0dc26a9f458 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:41.411014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-41001e45-a2e7-4c18-9f20-f0dc26a9f458 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1279 microversion: 2.1 time: 0.211834 May 26 19:39:41.422057 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 142/295] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:41 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:41.808273 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-b8809f1b-cd88-42b2-b2d9-5ccb2d807d66 req-0a8d032c-92bf-4e7d-b1c1-b007d7c70966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d24bae-e684-487b-88b1-c134195fe54f", "tag": "c9b0aa22-b532-4ac9-a353-da7eed5a3b37"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:41.820688 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-b8809f1b-cd88-42b2-b2d9-5ccb2d807d66 req-0a8d032c-92bf-4e7d-b1c1-b007d7c70966 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:41.826311 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-b8809f1b-cd88-42b2-b2d9-5ccb2d807d66 req-0a8d032c-92bf-4e7d-b1c1-b007d7c70966 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:41.832650 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-b8809f1b-cd88-42b2-b2d9-5ccb2d807d66 req-0a8d032c-92bf-4e7d-b1c1-b007d7c70966 service nova] Creating event network-changed:c9b0aa22-b532-4ac9-a353-da7eed5a3b37 for instance 41d24bae-e684-487b-88b1-c134195fe54f on hv-cinder-82549 May 26 19:39:41.838429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-b8809f1b-cd88-42b2-b2d9-5ccb2d807d66 req-0a8d032c-92bf-4e7d-b1c1-b007d7c70966 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034439 May 26 19:39:41.839655 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 154/296] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:42.430239 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-214fa6a5-a786-4ddb-afc2-aa351d287a40 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:42.431700 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-214fa6a5-a786-4ddb-afc2-aa351d287a40 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:42.444659 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-214fa6a5-a786-4ddb-afc2-aa351d287a40 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:42.447416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-214fa6a5-a786-4ddb-afc2-aa351d287a40 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:42.447416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-214fa6a5-a786-4ddb-afc2-aa351d287a40 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:42.447416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-214fa6a5-a786-4ddb-afc2-aa351d287a40 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:42.782093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-214fa6a5-a786-4ddb-afc2-aa351d287a40 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:42.790325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-214fa6a5-a786-4ddb-afc2-aa351d287a40 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.364883 May 26 19:39:42.790933 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 143/297] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:42 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:43.809192 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f9a5084a-49e7-4d13-9435-3d036a3db775 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:43.809949 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f9a5084a-49e7-4d13-9435-3d036a3db775 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:43.816200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f9a5084a-49e7-4d13-9435-3d036a3db775 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:43.816647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f9a5084a-49e7-4d13-9435-3d036a3db775 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:43.817400 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f9a5084a-49e7-4d13-9435-3d036a3db775 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:43.823073 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f9a5084a-49e7-4d13-9435-3d036a3db775 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:43.982281 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f9a5084a-49e7-4d13-9435-3d036a3db775 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:43.990181 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f9a5084a-49e7-4d13-9435-3d036a3db775 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.186261 May 26 19:39:43.990774 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 155/298] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:43 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:45.007150 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a50ab7da-3f61-49d8-afe4-158009dcc48a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:45.007790 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a50ab7da-3f61-49d8-afe4-158009dcc48a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:45.014209 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a50ab7da-3f61-49d8-afe4-158009dcc48a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:45.014649 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a50ab7da-3f61-49d8-afe4-158009dcc48a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:45.015449 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a50ab7da-3f61-49d8-afe4-158009dcc48a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:45.015882 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a50ab7da-3f61-49d8-afe4-158009dcc48a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:45.154080 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a50ab7da-3f61-49d8-afe4-158009dcc48a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:45.161903 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a50ab7da-3f61-49d8-afe4-158009dcc48a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.158872 May 26 19:39:45.162484 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 144/299] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:45 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:46.179353 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-71dd5cd3-2a64-4849-bc2c-65361787e5fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:46.179954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-71dd5cd3-2a64-4849-bc2c-65361787e5fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:46.186677 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-71dd5cd3-2a64-4849-bc2c-65361787e5fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:46.187470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-71dd5cd3-2a64-4849-bc2c-65361787e5fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:46.188231 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-71dd5cd3-2a64-4849-bc2c-65361787e5fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:46.188660 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-71dd5cd3-2a64-4849-bc2c-65361787e5fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:46.320037 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-71dd5cd3-2a64-4849-bc2c-65361787e5fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:46.327503 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-71dd5cd3-2a64-4849-bc2c-65361787e5fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.152199 May 26 19:39:46.328279 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 156/300] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:46 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:47.345264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3eca29f4-0563-48e3-a369-8ff99601bc61 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:47.345945 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3eca29f4-0563-48e3-a369-8ff99601bc61 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:47.348644 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:47.355002 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3eca29f4-0563-48e3-a369-8ff99601bc61 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:47.355002 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3eca29f4-0563-48e3-a369-8ff99601bc61 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:47.355410 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3eca29f4-0563-48e3-a369-8ff99601bc61 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:47.357610 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3eca29f4-0563-48e3-a369-8ff99601bc61 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:47.542156 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3eca29f4-0563-48e3-a369-8ff99601bc61 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:47.549692 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3eca29f4-0563-48e3-a369-8ff99601bc61 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.208505 May 26 19:39:47.550338 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 145/301] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:47 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:47.829348 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-533525667", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:47.835683 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:47.881258 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] validate_networks() for None {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:39:48.147786 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:39:48.148206 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:39:48.148673 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:39:48.149077 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:39:48.149483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:39:48.158311 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:48.158754 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:48.159592 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:48.160024 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:48.176315 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Getting quotas for project 79493f5efacb46fa9cb268ab70d70b16. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:39:48.180873 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Getting quotas for user 5865901fc24c40ccaa2265b291af1cf5 and project 79493f5efacb46fa9cb268ab70d70b16. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:39:48.191866 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:39:48.194575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:39:48.373365 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d33e524e-ccda-4458-99c4-7a9a022de8ae tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547791 May 26 19:39:48.379266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 157/302] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:39:48.384631 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7b94ecb1-3085-4525-b1fb-8ceb923786be tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:48.385262 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7b94ecb1-3085-4525-b1fb-8ceb923786be tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:48.387134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=8 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:48.444402 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7b94ecb1-3085-4525-b1fb-8ceb923786be tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:48.451499 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7b94ecb1-3085-4525-b1fb-8ceb923786be tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1214 microversion: 2.1 time: 0.071362 May 26 19:39:48.452064 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 146/303] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:48 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:48.565948 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b7094267-8853-4361-9cb2-a7942d337bbe tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:48.566556 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b7094267-8853-4361-9cb2-a7942d337bbe tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:48.572879 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b7094267-8853-4361-9cb2-a7942d337bbe tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:48.573331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b7094267-8853-4361-9cb2-a7942d337bbe tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:48.574103 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b7094267-8853-4361-9cb2-a7942d337bbe tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:48.574546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b7094267-8853-4361-9cb2-a7942d337bbe tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:48.709640 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b7094267-8853-4361-9cb2-a7942d337bbe tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:48.719673 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b7094267-8853-4361-9cb2-a7942d337bbe tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.155921 May 26 19:39:48.719673 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 158/304] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:48 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:49.470733 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b59e894c-83c6-4529-ac2f-8ee5dc1b10b8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:49.471367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b59e894c-83c6-4529-ac2f-8ee5dc1b10b8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:49.526325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b59e894c-83c6-4529-ac2f-8ee5dc1b10b8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:49.533050 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b59e894c-83c6-4529-ac2f-8ee5dc1b10b8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1214 microversion: 2.1 time: 0.066154 May 26 19:39:49.533614 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 147/305] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:49 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:49.734726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-968662a6-10ef-4c34-8a46-63470ffb59ce tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:49.735406 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-968662a6-10ef-4c34-8a46-63470ffb59ce tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:49.742824 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-968662a6-10ef-4c34-8a46-63470ffb59ce tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:49.743461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-968662a6-10ef-4c34-8a46-63470ffb59ce tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:49.744225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-968662a6-10ef-4c34-8a46-63470ffb59ce tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:49.744831 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-968662a6-10ef-4c34-8a46-63470ffb59ce tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:49.884372 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-968662a6-10ef-4c34-8a46-63470ffb59ce tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:49.893122 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-968662a6-10ef-4c34-8a46-63470ffb59ce tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.162130 May 26 19:39:49.893820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 159/306] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:49 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:50.549999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-35d2c613-c180-45cd-88a0-957cab9d3883 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:50.551144 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-35d2c613-c180-45cd-88a0-957cab9d3883 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:50.558448 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-35d2c613-c180-45cd-88a0-957cab9d3883 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:50.558930 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-35d2c613-c180-45cd-88a0-957cab9d3883 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:50.559923 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-35d2c613-c180-45cd-88a0-957cab9d3883 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:50.560438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-35d2c613-c180-45cd-88a0-957cab9d3883 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:50.624187 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-35d2c613-c180-45cd-88a0-957cab9d3883 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:50.632245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-35d2c613-c180-45cd-88a0-957cab9d3883 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1266 microversion: 2.1 time: 0.085621 May 26 19:39:50.632811 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 148/307] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:50 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:50.913674 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0dda0aee-05e8-482e-baa5-41af04f8d112 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:50.914228 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0dda0aee-05e8-482e-baa5-41af04f8d112 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:50.920804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0dda0aee-05e8-482e-baa5-41af04f8d112 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:50.921253 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0dda0aee-05e8-482e-baa5-41af04f8d112 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:50.922010 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0dda0aee-05e8-482e-baa5-41af04f8d112 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:50.922443 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0dda0aee-05e8-482e-baa5-41af04f8d112 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:51.058518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0dda0aee-05e8-482e-baa5-41af04f8d112 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:51.067341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0dda0aee-05e8-482e-baa5-41af04f8d112 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.157610 May 26 19:39:51.074363 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 160/308] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:50 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:51.439795 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-dd6562b8-799d-4597-b155-51b544dda441 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:51.440318 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-dd6562b8-799d-4597-b155-51b544dda441 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:51.446400 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dd6562b8-799d-4597-b155-51b544dda441 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:51.446847 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dd6562b8-799d-4597-b155-51b544dda441 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:51.447647 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dd6562b8-799d-4597-b155-51b544dda441 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:51.448082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dd6562b8-799d-4597-b155-51b544dda441 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:51.470197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-dd6562b8-799d-4597-b155-51b544dda441 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/ips" status: 200 len: 153 microversion: 2.20 time: 0.034481 May 26 19:39:51.472104 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 149/309] 10.222.0.72 () {60 vars in 1288 bytes} [Thu May 26 19:39:51 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/ips => generated 153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:39:51.648744 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5c8bebba-88a9-4158-bb7c-faad85520614 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:51.649347 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5c8bebba-88a9-4158-bb7c-faad85520614 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:51.655368 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c8bebba-88a9-4158-bb7c-faad85520614 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:51.655813 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c8bebba-88a9-4158-bb7c-faad85520614 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:51.656563 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c8bebba-88a9-4158-bb7c-faad85520614 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:51.656994 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c8bebba-88a9-4158-bb7c-faad85520614 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:51.717105 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5c8bebba-88a9-4158-bb7c-faad85520614 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:51.725529 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5c8bebba-88a9-4158-bb7c-faad85520614 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1272 microversion: 2.1 time: 0.080102 May 26 19:39:51.726103 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 161/310] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:51 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:52.080524 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-4d3cf36e-f250-4c16-b942-932ffaca582e req-60970a66-711e-4a82-91c5-ac590cb700e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d24bae-e684-487b-88b1-c134195fe54f", "name": "network-vif-plugged", "status": "completed", "tag": "c9b0aa22-b532-4ac9-a353-da7eed5a3b37"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:52.087858 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9c516076-da85-4e35-b7fb-4d22748ad4b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:52.087858 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9c516076-da85-4e35-b7fb-4d22748ad4b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:52.089650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-4d3cf36e-f250-4c16-b942-932ffaca582e req-60970a66-711e-4a82-91c5-ac590cb700e5 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:52.090101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-4d3cf36e-f250-4c16-b942-932ffaca582e req-60970a66-711e-4a82-91c5-ac590cb700e5 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:52.093632 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9c516076-da85-4e35-b7fb-4d22748ad4b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:52.094152 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9c516076-da85-4e35-b7fb-4d22748ad4b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:52.095990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9c516076-da85-4e35-b7fb-4d22748ad4b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:52.096437 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9c516076-da85-4e35-b7fb-4d22748ad4b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:52.101226 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=100 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:52.101665 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-4d3cf36e-f250-4c16-b942-932ffaca582e req-60970a66-711e-4a82-91c5-ac590cb700e5 service nova] Creating event network-vif-plugged:c9b0aa22-b532-4ac9-a353-da7eed5a3b37 for instance 41d24bae-e684-487b-88b1-c134195fe54f on hv-cinder-82549 May 26 19:39:52.106729 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-4d3cf36e-f250-4c16-b942-932ffaca582e req-60970a66-711e-4a82-91c5-ac590cb700e5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029897 May 26 19:39:52.107352 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 150/311] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:52.260023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9c516076-da85-4e35-b7fb-4d22748ad4b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:52.267755 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9c516076-da85-4e35-b7fb-4d22748ad4b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.186680 May 26 19:39:52.276020 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 162/312] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:52 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:52.745986 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0bdfb700-52ce-485c-a808-de8a32be0aa7 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:52.746691 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0bdfb700-52ce-485c-a808-de8a32be0aa7 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:52.753788 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0bdfb700-52ce-485c-a808-de8a32be0aa7 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:52.754390 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0bdfb700-52ce-485c-a808-de8a32be0aa7 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:52.755196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0bdfb700-52ce-485c-a808-de8a32be0aa7 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:52.756042 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0bdfb700-52ce-485c-a808-de8a32be0aa7 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:52.760817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=100 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:52.966018 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0bdfb700-52ce-485c-a808-de8a32be0aa7 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:52.973468 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0bdfb700-52ce-485c-a808-de8a32be0aa7 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.234316 May 26 19:39:52.974024 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 151/313] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:52 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:53.286999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-78579b58-a556-4647-9ee9-dcc37f16178b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:53.287690 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-78579b58-a556-4647-9ee9-dcc37f16178b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:53.294521 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-78579b58-a556-4647-9ee9-dcc37f16178b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:53.295159 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-78579b58-a556-4647-9ee9-dcc37f16178b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:53.295952 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-78579b58-a556-4647-9ee9-dcc37f16178b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:53.296393 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-78579b58-a556-4647-9ee9-dcc37f16178b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:53.472779 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-78579b58-a556-4647-9ee9-dcc37f16178b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:53.480855 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-78579b58-a556-4647-9ee9-dcc37f16178b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.199202 May 26 19:39:53.481432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 163/314] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:53 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:53.537174 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-20bbb5b0-3c7c-4019-8522-0d304f81dc30 req-a47ae3c9-709d-4707-a5ba-d3c741009f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a034f0b-93aa-426c-9534-67a5f7c38cae", "tag": "7005868c-4fa7-424c-92b1-b03647840cd7"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:53.549534 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-20bbb5b0-3c7c-4019-8522-0d304f81dc30 req-a47ae3c9-709d-4707-a5ba-d3c741009f48 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:53.550207 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-20bbb5b0-3c7c-4019-8522-0d304f81dc30 req-a47ae3c9-709d-4707-a5ba-d3c741009f48 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:53.562652 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-20bbb5b0-3c7c-4019-8522-0d304f81dc30 req-a47ae3c9-709d-4707-a5ba-d3c741009f48 service nova] Creating event network-changed:7005868c-4fa7-424c-92b1-b03647840cd7 for instance 9a034f0b-93aa-426c-9534-67a5f7c38cae on hv-cinder-82549 May 26 19:39:53.567487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-20bbb5b0-3c7c-4019-8522-0d304f81dc30 req-a47ae3c9-709d-4707-a5ba-d3c741009f48 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033949 May 26 19:39:53.568102 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 152/315] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:39:53.989317 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6fb23407-9feb-49e8-91bb-0a8bfa392b7a tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:53.990171 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6fb23407-9feb-49e8-91bb-0a8bfa392b7a tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:53.996558 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6fb23407-9feb-49e8-91bb-0a8bfa392b7a tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:53.997008 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6fb23407-9feb-49e8-91bb-0a8bfa392b7a tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:53.997762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6fb23407-9feb-49e8-91bb-0a8bfa392b7a tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:53.998193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6fb23407-9feb-49e8-91bb-0a8bfa392b7a tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:54.123762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6fb23407-9feb-49e8-91bb-0a8bfa392b7a tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:54.131154 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6fb23407-9feb-49e8-91bb-0a8bfa392b7a tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.145583 May 26 19:39:54.132285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 164/316] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:53 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:54.282948 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1f536c81-02d0-44ec-9bce-74f0e441a1fb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:39:54.283567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1f536c81-02d0-44ec-9bce-74f0e441a1fb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:54.289777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f536c81-02d0-44ec-9bce-74f0e441a1fb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:54.290226 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f536c81-02d0-44ec-9bce-74f0e441a1fb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:54.291019 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f536c81-02d0-44ec-9bce-74f0e441a1fb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:54.291462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f536c81-02d0-44ec-9bce-74f0e441a1fb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:54.313590 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-1f536c81-02d0-44ec-9bce-74f0e441a1fb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lazy-loading 'flavor' on Instance uuid 915b2746-efa1-4bc1-897f-dd3382e94a03 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:39:54.497864 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6dfa545a-4d08-47fc-a0ae-669fca82df0e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:54.498441 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6dfa545a-4d08-47fc-a0ae-669fca82df0e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:54.504906 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6dfa545a-4d08-47fc-a0ae-669fca82df0e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:54.505347 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6dfa545a-4d08-47fc-a0ae-669fca82df0e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:54.506096 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6dfa545a-4d08-47fc-a0ae-669fca82df0e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:54.506599 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6dfa545a-4d08-47fc-a0ae-669fca82df0e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:54.639053 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6dfa545a-4d08-47fc-a0ae-669fca82df0e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:54.646769 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6dfa545a-4d08-47fc-a0ae-669fca82df0e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.152711 May 26 19:39:54.647405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 165/317] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:54 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:54.840179 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1f536c81-02d0-44ec-9bce-74f0e441a1fb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/action" status: 202 len: 0 microversion: 2.20 time: 0.561150 May 26 19:39:54.840812 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 153/318] 10.222.0.72 () {62 vars in 1318 bytes} [Thu May 26 19:39:54 2022] POST /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 19:39:54.848914 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:54.849514 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:54.856217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:54.856664 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:54.857410 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:54.857837 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:54.983634 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:54.991663 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:54.993190 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:54.994327 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8a50bd70-f9dc-451c-85ff-35a8c59be08f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.149367 May 26 19:39:54.994874 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 166/319] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:39:54 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:39:55.154518 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7f9ea203-32af-4f27-ac60-e902c5ec2dc1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:55.155248 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7f9ea203-32af-4f27-ac60-e902c5ec2dc1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:55.161542 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7f9ea203-32af-4f27-ac60-e902c5ec2dc1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:55.161987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7f9ea203-32af-4f27-ac60-e902c5ec2dc1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:55.162735 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7f9ea203-32af-4f27-ac60-e902c5ec2dc1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:55.163195 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7f9ea203-32af-4f27-ac60-e902c5ec2dc1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:55.292857 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7f9ea203-32af-4f27-ac60-e902c5ec2dc1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:55.300190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7f9ea203-32af-4f27-ac60-e902c5ec2dc1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.149951 May 26 19:39:55.300744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 154/320] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:55 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:55.663904 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-116dbcd7-45c6-43c7-ae44-8fc096b60ad7 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:55.664516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-116dbcd7-45c6-43c7-ae44-8fc096b60ad7 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:55.670863 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-116dbcd7-45c6-43c7-ae44-8fc096b60ad7 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:55.671342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-116dbcd7-45c6-43c7-ae44-8fc096b60ad7 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:55.672087 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-116dbcd7-45c6-43c7-ae44-8fc096b60ad7 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:55.672516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-116dbcd7-45c6-43c7-ae44-8fc096b60ad7 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:55.798568 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-116dbcd7-45c6-43c7-ae44-8fc096b60ad7 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:55.806594 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-116dbcd7-45c6-43c7-ae44-8fc096b60ad7 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.146568 May 26 19:39:55.809792 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 167/321] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:55 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:56.012938 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:56.013545 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:56.020143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:56.020596 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:56.021355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:56.021793 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:56.146367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:56.154516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:56.156076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:56.157208 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a1702821-fe6b-4005-9b85-370e9ee70fa8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.148282 May 26 19:39:56.162796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 155/322] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:39:56 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:39:56.316818 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9b8dd8ab-cd30-4fd6-ac52-231a634c8d98 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:56.317427 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9b8dd8ab-cd30-4fd6-ac52-231a634c8d98 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:56.323450 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9b8dd8ab-cd30-4fd6-ac52-231a634c8d98 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:56.323898 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9b8dd8ab-cd30-4fd6-ac52-231a634c8d98 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:56.324653 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9b8dd8ab-cd30-4fd6-ac52-231a634c8d98 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:56.325088 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9b8dd8ab-cd30-4fd6-ac52-231a634c8d98 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:56.455276 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9b8dd8ab-cd30-4fd6-ac52-231a634c8d98 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:56.463975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9b8dd8ab-cd30-4fd6-ac52-231a634c8d98 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.150999 May 26 19:39:56.465045 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 168/323] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:56 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:56.825836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0e072aa4-8f2b-46f2-aa9e-8178482fb675 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:56.825836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0e072aa4-8f2b-46f2-aa9e-8178482fb675 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:56.832091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e072aa4-8f2b-46f2-aa9e-8178482fb675 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:56.832540 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e072aa4-8f2b-46f2-aa9e-8178482fb675 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:56.833321 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e072aa4-8f2b-46f2-aa9e-8178482fb675 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:56.833759 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e072aa4-8f2b-46f2-aa9e-8178482fb675 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:56.968374 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0e072aa4-8f2b-46f2-aa9e-8178482fb675 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:56.975934 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0e072aa4-8f2b-46f2-aa9e-8178482fb675 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1267 microversion: 2.1 time: 0.155543 May 26 19:39:56.976503 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 156/324] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:56 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:39:57.176261 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:57.176903 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:57.183852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:57.184306 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:57.185068 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:57.185506 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:57.311222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:57.319097 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:57.321173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:57.322321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0c9a8f38-8537-4db1-86a6-67b1fea16d91 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.150239 May 26 19:39:57.322928 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 169/325] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:39:57 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:39:57.481867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-71a115b3-8903-40c8-9475-a9b0926465eb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:57.482528 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-71a115b3-8903-40c8-9475-a9b0926465eb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:57.489270 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-71a115b3-8903-40c8-9475-a9b0926465eb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:57.489984 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-71a115b3-8903-40c8-9475-a9b0926465eb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:57.490745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-71a115b3-8903-40c8-9475-a9b0926465eb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:57.491204 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-71a115b3-8903-40c8-9475-a9b0926465eb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:57.632055 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-71a115b3-8903-40c8-9475-a9b0926465eb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:57.639668 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-71a115b3-8903-40c8-9475-a9b0926465eb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.161715 May 26 19:39:57.640248 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 157/326] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:57 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:57.993866 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a5f47597-6e8b-43fe-83f5-7835c96d1c79 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:57.996320 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a5f47597-6e8b-43fe-83f5-7835c96d1c79 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:58.013351 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a5f47597-6e8b-43fe-83f5-7835c96d1c79 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:58.013931 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a5f47597-6e8b-43fe-83f5-7835c96d1c79 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:58.014771 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a5f47597-6e8b-43fe-83f5-7835c96d1c79 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:58.015370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a5f47597-6e8b-43fe-83f5-7835c96d1c79 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:58.150801 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a5f47597-6e8b-43fe-83f5-7835c96d1c79 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:58.158630 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a5f47597-6e8b-43fe-83f5-7835c96d1c79 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1454 microversion: 2.1 time: 0.169537 May 26 19:39:58.162667 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 170/327] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:57 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:58.175880 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bc75df39-39db-4acd-b2ba-5c8cca73e08b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:58.176496 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bc75df39-39db-4acd-b2ba-5c8cca73e08b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:58.183408 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bc75df39-39db-4acd-b2ba-5c8cca73e08b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:58.185646 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bc75df39-39db-4acd-b2ba-5c8cca73e08b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:58.185646 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bc75df39-39db-4acd-b2ba-5c8cca73e08b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:58.186029 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bc75df39-39db-4acd-b2ba-5c8cca73e08b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:58.340620 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:58.341252 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:58.343184 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:58.348442 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:58.350374 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:58.350374 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:58.350374 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:58.449837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-bc75df39-39db-4acd-b2ba-5c8cca73e08b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:58.458118 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bc75df39-39db-4acd-b2ba-5c8cca73e08b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1454 microversion: 2.1 time: 0.285701 May 26 19:39:58.458745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 158/328] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:58 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1454 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:58.491045 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:58.500278 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:58.502163 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:58.503443 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8143be0c-32a5-4d3a-9ac3-f058e4c6e00b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.166850 May 26 19:39:58.504471 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 171/329] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:39:58 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:39:58.657615 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8f2d4d17-e70f-4003-96b2-b49f9cddfed3 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:58.658384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8f2d4d17-e70f-4003-96b2-b49f9cddfed3 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:58.665324 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f2d4d17-e70f-4003-96b2-b49f9cddfed3 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:58.665764 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f2d4d17-e70f-4003-96b2-b49f9cddfed3 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:58.666519 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f2d4d17-e70f-4003-96b2-b49f9cddfed3 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:58.666971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f2d4d17-e70f-4003-96b2-b49f9cddfed3 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:59.004167 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8f2d4d17-e70f-4003-96b2-b49f9cddfed3 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:59.012156 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8f2d4d17-e70f-4003-96b2-b49f9cddfed3 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.358345 May 26 19:39:59.012725 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 159/330] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:39:58 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:39:59.521418 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:39:59.522021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:39:59.524297 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=6 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:59.530259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:59.530703 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:59.531590 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:39:59.532019 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:39:59.878387 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:59.886648 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:59.888223 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:39:59.889434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8b30296b-3218-4cbc-a88c-e8de0d4901bc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.372527 May 26 19:39:59.889983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 172/331] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:39:59 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:00.029720 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1f4d2f87-6eee-4b80-bfaf-1afaa1567284 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:00.031042 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1f4d2f87-6eee-4b80-bfaf-1afaa1567284 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:00.036800 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=4 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:00.038828 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f4d2f87-6eee-4b80-bfaf-1afaa1567284 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:00.039896 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f4d2f87-6eee-4b80-bfaf-1afaa1567284 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:00.040712 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f4d2f87-6eee-4b80-bfaf-1afaa1567284 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:00.041151 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f4d2f87-6eee-4b80-bfaf-1afaa1567284 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:00.176606 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1f4d2f87-6eee-4b80-bfaf-1afaa1567284 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:00.183975 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1f4d2f87-6eee-4b80-bfaf-1afaa1567284 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.158255 May 26 19:40:00.184543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 160/332] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:00 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:00.908509 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:00.910243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:00.916056 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:00.917005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:00.917944 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:00.918410 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:01.077625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-0e8ca3d1-53eb-4b84-896b-4be078edcd5d req-86cd7ad1-2011-4108-ab1e-233fe3cf3d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d24bae-e684-487b-88b1-c134195fe54f", "tag": "c9b0aa22-b532-4ac9-a353-da7eed5a3b37"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:01.084689 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-0e8ca3d1-53eb-4b84-896b-4be078edcd5d req-86cd7ad1-2011-4108-ab1e-233fe3cf3d99 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:01.085143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-0e8ca3d1-53eb-4b84-896b-4be078edcd5d req-86cd7ad1-2011-4108-ab1e-233fe3cf3d99 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:01.096391 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-0e8ca3d1-53eb-4b84-896b-4be078edcd5d req-86cd7ad1-2011-4108-ab1e-233fe3cf3d99 service nova] Creating event network-changed:c9b0aa22-b532-4ac9-a353-da7eed5a3b37 for instance 41d24bae-e684-487b-88b1-c134195fe54f on hv-cinder-82549 May 26 19:40:01.100194 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:01.101579 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-0e8ca3d1-53eb-4b84-896b-4be078edcd5d req-86cd7ad1-2011-4108-ab1e-233fe3cf3d99 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031505 May 26 19:40:01.103037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 161/333] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:40:01.110854 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:01.112073 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:01.113265 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-11ad5cff-78a1-4b13-91d6-4cf0c03ffc12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.209218 May 26 19:40:01.113819 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 173/334] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:00 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:01.201384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-81600662-be5d-42a1-be4e-4f1c982293fb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:01.202107 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-81600662-be5d-42a1-be4e-4f1c982293fb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:01.208491 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81600662-be5d-42a1-be4e-4f1c982293fb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:01.208951 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81600662-be5d-42a1-be4e-4f1c982293fb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:01.209721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81600662-be5d-42a1-be4e-4f1c982293fb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:01.210165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81600662-be5d-42a1-be4e-4f1c982293fb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:01.347490 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-81600662-be5d-42a1-be4e-4f1c982293fb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:01.356996 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-81600662-be5d-42a1-be4e-4f1c982293fb tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.159912 May 26 19:40:01.357940 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 162/335] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:01 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:02.132153 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:02.132763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:02.140173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:02.140618 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:02.141381 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:02.141815 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:02.271434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:02.279953 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:02.281582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:02.282807 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7c0313a4-d08f-460e-bec2-d6d84d110dfe tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.155081 May 26 19:40:02.293865 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 174/336] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:02 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:02.375078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fb4fcaf9-be1a-4862-bd59-e8f29a07a5f8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:02.375697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fb4fcaf9-be1a-4862-bd59-e8f29a07a5f8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:02.382195 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb4fcaf9-be1a-4862-bd59-e8f29a07a5f8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:02.382644 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb4fcaf9-be1a-4862-bd59-e8f29a07a5f8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:02.384017 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb4fcaf9-be1a-4862-bd59-e8f29a07a5f8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:02.384447 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb4fcaf9-be1a-4862-bd59-e8f29a07a5f8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:02.519332 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fb4fcaf9-be1a-4862-bd59-e8f29a07a5f8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:02.526639 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fb4fcaf9-be1a-4862-bd59-e8f29a07a5f8 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.155505 May 26 19:40:02.527233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 163/337] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:02 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:03.301557 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:03.302164 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:03.308328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:03.308770 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:03.309618 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:03.310051 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:03.461539 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:03.470350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:03.471846 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:03.473008 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c7bde61a-ee4e-4df4-931c-49f7087ee361 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.175526 May 26 19:40:03.473556 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 175/338] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:03 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:03.548019 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7ceb5e80-82ef-4bdb-8bc5-db27c327a7fa tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:03.548019 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7ceb5e80-82ef-4bdb-8bc5-db27c327a7fa tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:03.552322 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7ceb5e80-82ef-4bdb-8bc5-db27c327a7fa tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:03.552774 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7ceb5e80-82ef-4bdb-8bc5-db27c327a7fa tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:03.553544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7ceb5e80-82ef-4bdb-8bc5-db27c327a7fa tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:03.554101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7ceb5e80-82ef-4bdb-8bc5-db27c327a7fa tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:03.685722 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7ceb5e80-82ef-4bdb-8bc5-db27c327a7fa tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:03.693092 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7ceb5e80-82ef-4bdb-8bc5-db27c327a7fa tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.154232 May 26 19:40:03.693662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 164/339] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:03 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:04.497074 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:04.498396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:04.504739 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:04.505191 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:04.505961 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:04.506402 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:04.544063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-100ff07c-7e8e-4352-8dbd-b7528f707db2 req-92f5237c-0a87-4598-8205-6626f313a827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a034f0b-93aa-426c-9534-67a5f7c38cae", "name": "network-vif-plugged", "status": "completed", "tag": "7005868c-4fa7-424c-92b1-b03647840cd7"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:04.553008 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-100ff07c-7e8e-4352-8dbd-b7528f707db2 req-92f5237c-0a87-4598-8205-6626f313a827 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:04.553619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-100ff07c-7e8e-4352-8dbd-b7528f707db2 req-92f5237c-0a87-4598-8205-6626f313a827 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:04.565574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-100ff07c-7e8e-4352-8dbd-b7528f707db2 req-92f5237c-0a87-4598-8205-6626f313a827 service nova] Creating event network-vif-plugged:7005868c-4fa7-424c-92b1-b03647840cd7 for instance 9a034f0b-93aa-426c-9534-67a5f7c38cae on hv-cinder-82549 May 26 19:40:04.571035 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-100ff07c-7e8e-4352-8dbd-b7528f707db2 req-92f5237c-0a87-4598-8205-6626f313a827 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029911 May 26 19:40:04.571035 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 165/340] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:40:04.651555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:04.660244 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:04.662518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:04.664973 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7c8a80d6-da82-425c-9759-67b718e2dbc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.171163 May 26 19:40:04.667141 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 176/341] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:04 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:04.718679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-16e9da41-fa15-46ec-826a-8d92a3ae58e5 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:04.718679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-16e9da41-fa15-46ec-826a-8d92a3ae58e5 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:04.723214 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-16e9da41-fa15-46ec-826a-8d92a3ae58e5 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:04.723717 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-16e9da41-fa15-46ec-826a-8d92a3ae58e5 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:04.724492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-16e9da41-fa15-46ec-826a-8d92a3ae58e5 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:04.724930 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-16e9da41-fa15-46ec-826a-8d92a3ae58e5 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:04.874108 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-16e9da41-fa15-46ec-826a-8d92a3ae58e5 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:04.881834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-16e9da41-fa15-46ec-826a-8d92a3ae58e5 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.174841 May 26 19:40:04.882409 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 166/342] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:04 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:05.684490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:05.691671 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:05.691671 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:05.691957 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:05.692706 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:05.693174 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:05.818160 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:05.826055 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:05.827593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:05.828752 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d35f9313-45c6-4a0d-99ce-12f71d83e6c1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.148767 May 26 19:40:05.841019 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 177/343] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:05 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:05.899263 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-40034cea-8b0b-4d45-bcfc-832db5e05140 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:05.899873 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-40034cea-8b0b-4d45-bcfc-832db5e05140 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:05.906294 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-40034cea-8b0b-4d45-bcfc-832db5e05140 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:05.906743 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-40034cea-8b0b-4d45-bcfc-832db5e05140 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:05.917947 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-40034cea-8b0b-4d45-bcfc-832db5e05140 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:05.917947 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-40034cea-8b0b-4d45-bcfc-832db5e05140 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:06.045670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-40034cea-8b0b-4d45-bcfc-832db5e05140 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:06.048028 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:06.053758 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-40034cea-8b0b-4d45-bcfc-832db5e05140 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.158446 May 26 19:40:06.054324 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 167/344] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:05 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:06.846932 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:06.847535 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:06.853901 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:06.854344 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:06.855118 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:06.855543 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:06.985196 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:06.988932 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=100 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:06.995201 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:06.996702 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:06.997911 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b0e0834f-b50e-40db-8e27-e5ab6a4a2bea tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.154952 May 26 19:40:06.998518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 178/345] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:06 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:07.070048 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-62ff7905-e4dc-4b79-9db6-d7ed499ea28f tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:07.071068 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-62ff7905-e4dc-4b79-9db6-d7ed499ea28f tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:07.077943 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-62ff7905-e4dc-4b79-9db6-d7ed499ea28f tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:07.078394 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-62ff7905-e4dc-4b79-9db6-d7ed499ea28f tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:07.079180 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-62ff7905-e4dc-4b79-9db6-d7ed499ea28f tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:07.079622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-62ff7905-e4dc-4b79-9db6-d7ed499ea28f tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:07.213848 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-62ff7905-e4dc-4b79-9db6-d7ed499ea28f tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:07.221276 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-62ff7905-e4dc-4b79-9db6-d7ed499ea28f tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1314 microversion: 2.1 time: 0.155641 May 26 19:40:07.221842 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 168/346] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:07 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:08.016519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:08.017116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:08.024373 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:08.025076 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:08.026241 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:08.026679 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:08.163355 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:08.171269 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:08.172771 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:08.173920 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-29a3fd4a-f32f-4491-b97b-fa93c4b84919 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.161591 May 26 19:40:08.174479 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 179/347] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:08 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:08.238219 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-428800e5-56b5-406a-8285-042fc67f4fa4 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:08.238751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-428800e5-56b5-406a-8285-042fc67f4fa4 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:08.241376 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=66 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:08.246656 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-428800e5-56b5-406a-8285-042fc67f4fa4 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:08.247148 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-428800e5-56b5-406a-8285-042fc67f4fa4 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:08.247906 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-428800e5-56b5-406a-8285-042fc67f4fa4 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:08.248343 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-428800e5-56b5-406a-8285-042fc67f4fa4 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:08.401671 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-428800e5-56b5-406a-8285-042fc67f4fa4 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:08.409120 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-428800e5-56b5-406a-8285-042fc67f4fa4 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1463 microversion: 2.1 time: 0.174838 May 26 19:40:08.409682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 169/348] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:08 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1463 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:08.449751 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ce133bc0-3d18-46d8-bd6e-dfa2c0adead1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:08.450248 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ce133bc0-3d18-46d8-bd6e-dfa2c0adead1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:08.456246 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ce133bc0-3d18-46d8-bd6e-dfa2c0adead1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:08.456695 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ce133bc0-3d18-46d8-bd6e-dfa2c0adead1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:08.457456 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ce133bc0-3d18-46d8-bd6e-dfa2c0adead1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:08.457890 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ce133bc0-3d18-46d8-bd6e-dfa2c0adead1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:08.482147 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ce133bc0-3d18-46d8-bd6e-dfa2c0adead1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:40:08.892126 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ce133bc0-3d18-46d8-bd6e-dfa2c0adead1 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 204 len: 0 microversion: 2.1 time: 0.446453 May 26 19:40:08.892719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 180/349] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:40:08 2022] DELETE /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:40:08.900948 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-30c49fb7-9ea9-40e4-83ba-aa9dc805fd89 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:08.901572 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-30c49fb7-9ea9-40e4-83ba-aa9dc805fd89 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:08.907718 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-30c49fb7-9ea9-40e4-83ba-aa9dc805fd89 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:08.908168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-30c49fb7-9ea9-40e4-83ba-aa9dc805fd89 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:08.908929 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-30c49fb7-9ea9-40e4-83ba-aa9dc805fd89 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:08.909462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-30c49fb7-9ea9-40e4-83ba-aa9dc805fd89 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:09.063132 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-30c49fb7-9ea9-40e4-83ba-aa9dc805fd89 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:09.063132 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-30c49fb7-9ea9-40e4-83ba-aa9dc805fd89 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1469 microversion: 2.1 time: 0.159248 May 26 19:40:09.063132 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 170/350] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:08 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:09.192314 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:09.192908 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:09.199342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:09.199787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:09.200537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:09.200964 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:09.331647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:09.340059 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:09.341553 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:09.342700 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-333fabd6-5268-4630-9c71-8489db351084 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.154782 May 26 19:40:09.343293 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 181/351] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:09 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:10.074284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6da675e3-bae8-4344-96a2-399ef1d869c0 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:10.075020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6da675e3-bae8-4344-96a2-399ef1d869c0 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:10.081686 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6da675e3-bae8-4344-96a2-399ef1d869c0 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:10.082204 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6da675e3-bae8-4344-96a2-399ef1d869c0 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:10.083085 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6da675e3-bae8-4344-96a2-399ef1d869c0 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:10.083582 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6da675e3-bae8-4344-96a2-399ef1d869c0 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:10.215801 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6da675e3-bae8-4344-96a2-399ef1d869c0 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:10.223166 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6da675e3-bae8-4344-96a2-399ef1d869c0 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1469 microversion: 2.1 time: 0.153420 May 26 19:40:10.223729 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 171/352] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:10 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:10.361617 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:10.362130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:10.365022 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:10.369985 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:10.370984 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:10.371184 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:10.371612 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:10.505596 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:10.514209 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:10.515815 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:10.517027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-dce9bf8c-d84f-4c99-b8a4-fa0fc7c7ff8b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.159342 May 26 19:40:10.517552 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 182/353] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:10 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:11.241196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4f7e69e5-0b23-43d2-ab72-f6514cefe90e tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:11.241720 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4f7e69e5-0b23-43d2-ab72-f6514cefe90e tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:11.248262 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4f7e69e5-0b23-43d2-ab72-f6514cefe90e tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:11.248711 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4f7e69e5-0b23-43d2-ab72-f6514cefe90e tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:11.249467 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4f7e69e5-0b23-43d2-ab72-f6514cefe90e tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:11.249900 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4f7e69e5-0b23-43d2-ab72-f6514cefe90e tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:11.474252 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4f7e69e5-0b23-43d2-ab72-f6514cefe90e tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:11.482289 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4f7e69e5-0b23-43d2-ab72-f6514cefe90e tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1469 microversion: 2.1 time: 0.245358 May 26 19:40:11.482875 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 172/354] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:11 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1469 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:11.535121 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:11.535744 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:11.542771 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:11.543257 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:11.544021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:11.544448 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:11.681074 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:11.689111 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:11.690628 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:11.691861 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8a70409e-514e-4dd6-be3b-70fc9c7e23a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.160722 May 26 19:40:11.702819 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 183/355] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:11 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:11.921756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-c93d092b-d0a8-49dd-b5f2-8058b0b66ddd req-cfc07da7-b8fb-4897-bc4e-57185a43e08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a034f0b-93aa-426c-9534-67a5f7c38cae", "name": "network-vif-deleted", "tag": "7005868c-4fa7-424c-92b1-b03647840cd7"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:11.930233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-c93d092b-d0a8-49dd-b5f2-8058b0b66ddd req-cfc07da7-b8fb-4897-bc4e-57185a43e08b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:11.930679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-c93d092b-d0a8-49dd-b5f2-8058b0b66ddd req-cfc07da7-b8fb-4897-bc4e-57185a43e08b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:11.942671 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-c93d092b-d0a8-49dd-b5f2-8058b0b66ddd req-cfc07da7-b8fb-4897-bc4e-57185a43e08b service nova] Creating event network-vif-deleted:7005868c-4fa7-424c-92b1-b03647840cd7 for instance 9a034f0b-93aa-426c-9534-67a5f7c38cae on hv-cinder-82549 May 26 19:40:11.953345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-c93d092b-d0a8-49dd-b5f2-8058b0b66ddd req-cfc07da7-b8fb-4897-bc4e-57185a43e08b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035353 May 26 19:40:11.954223 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 173/356] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:40:12.499479 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:12.499993 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:12.506050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:12.506497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:12.507284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:12.508024 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:12.541600 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:12.542224 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:12.542474 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lazy-loading 'fault' on Instance uuid 9a034f0b-93aa-426c-9534-67a5f7c38cae {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:40:12.584217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865901fc24c40ccaa2265b291af1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79493f5efacb46fa9cb268ab70d70b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:12.591737 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5905f2e5-98ca-4f28-841c-181f87ab53c2 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 200 len: 1304 microversion: 2.1 time: 0.096187 May 26 19:40:12.592298 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 184/357] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:12 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:12.711885 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:12.713081 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:12.719653 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:12.720106 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:12.720884 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:12.723636 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:12.862845 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:12.871175 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:12.872692 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:12.873877 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-698ac468-cbe8-4ea8-8297-a7a6103b01c3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.166980 May 26 19:40:12.874435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 174/358] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:12 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:13.609414 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:13.610082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] [instance: 9a034f0b-93aa-426c-9534-67a5f7c38cae] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:13.616979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:13.617432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:13.618604 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:13.619076 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:13.633559 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] HTTP exception thrown: Instance 9a034f0b-93aa-426c-9534-67a5f7c38cae could not be found. May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Request method failure captured: May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae HTTP/1.1 May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9eB3Z_IhcnsyEeUbBxcy4FgYdd896Ab-LjGfvufL8dMTZjobngKMTee3DBoxndkAutYt42sW0rvweUmerGR0mK5zCHEi69F8G1PJpIs2DcSFSIZtCuQ8msnaIrz_Dtnwst556jVR2yEA14EZV97_Er9GZ_tpK4mXeNrUD4zc2szDhs May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 79493f5efacb46fa9cb268ab70d70b16 May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-VolumesNegativeTest-2040244274 May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:40:13.635130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/79493f5efacb46fa9cb268ab70d70b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/79493f5efacb46fa9cb268ab70d70b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_79493f5efacb46fa9cb268ab70d70b16", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/79493f5efacb46fa9cb268ab70d70b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-VolumesNegativeTest-2040244274 May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 79493f5efacb46fa9cb268ab70d70b16 May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-VolumesNegativeTest-2040244274 May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-VolumesNegativeTest-2040244274-project May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 5865901fc24c40ccaa2265b291af1cf5 May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-VolumesNegativeTest-2040244274-project May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 9a034f0b-93aa-426c-9534-67a5f7c38cae could not be found. May 26 19:40:13.636820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '9a034f0b-93aa-426c-9534-67a5f7c38cae'} May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a034f0b-93aa-426c-9534-67a5f7c38cae could not be found. May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:40:13.637726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a034f0b-93aa-426c-9534-67a5f7c38cae could not be found. May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a034f0b-93aa-426c-9534-67a5f7c38cae could not be found. May 26 19:40:13.639014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:40:13.640115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] Returning 404 to user: Instance 9a034f0b-93aa-426c-9534-67a5f7c38cae could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:40:13.640115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b3436273-b802-4e26-92fa-5ac8198f79f9 tempest-VolumesNegativeTest-2040244274 tempest-VolumesNegativeTest-2040244274-project] 10.222.0.72 "GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae" status: 404 len: 111 microversion: 2.1 time: 0.032359 May 26 19:40:13.640115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 185/359] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:13 2022] GET /compute/v2.1/servers/9a034f0b-93aa-426c-9534-67a5f7c38cae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:40:13.892405 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:13.892975 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:13.899637 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:13.900757 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:13.901525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:13.901968 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:14.035595 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:14.043605 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:14.086478 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:14.086478 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-cb30fbb1-5b80-4db4-89b7-8dbe14825056 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.157938 May 26 19:40:14.086478 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 175/360] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:13 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:15.103186 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:15.103793 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:15.110643 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:15.111130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:15.111903 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:15.112341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:15.249194 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:15.257146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:15.258697 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:15.259930 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a2f87d6b-fcf1-4825-838a-48b0586cd29b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.160900 May 26 19:40:15.260474 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 186/361] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:15 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:16.279346 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:16.279954 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:16.286452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:16.286931 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:16.292014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:16.292014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:16.423093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:16.431646 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:16.433175 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:16.434315 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-de3c7dab-1908-4466-adbd-c5d8a6dd0ecf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.159452 May 26 19:40:16.434872 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 176/362] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:16 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:17.454089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:17.455370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:17.463302 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:17.465804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:17.465804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:17.465804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:17.594850 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:17.602928 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:17.604429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:17.605572 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7fb8f33c-2dfb-4716-88fc-4453d5bb1920 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.155889 May 26 19:40:17.606118 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 187/363] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:17 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:18.624180 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:18.624902 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:18.632126 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:18.632583 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:18.633373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:18.633814 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:18.794013 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:18.804462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:18.806724 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:18.807993 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5f459912-e879-4dda-8032-f9c6720d3930 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1745 microversion: 2.20 time: 0.187913 May 26 19:40:18.808864 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 177/364] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:18 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:40:19.826762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:19.827406 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:19.834405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:19.834857 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:19.835665 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:19.836100 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:19.970775 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:19.978645 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:19.980174 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:19.981321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2127e814-0f4e-4e7e-903b-e72dad700232 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1745 microversion: 2.20 time: 0.158522 May 26 19:40:19.981862 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 188/365] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:19 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:21.000036 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:21.000646 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:21.007160 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:21.007610 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:21.008409 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:21.008846 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:21.143689 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:21.151905 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:21.153416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:21.154564 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-69399b71-e10e-4a88-98e7-be47ec752eb5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1745 microversion: 2.20 time: 0.158469 May 26 19:40:21.155154 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 178/366] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:20 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:22.178816 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:22.180622 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:22.188537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:22.189230 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:22.190273 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:22.190915 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:22.385377 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:22.393851 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:22.395842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:22.397202 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9d38b3bb-fc3f-4212-ac62-702201d70303 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.228305 May 26 19:40:22.398092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 189/367] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:22 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:22.572002 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-fc1b8fdb-7445-4eb5-ac2b-797d56c1ea34 req-c689c599-efbf-4f63-80c5-bd75a039a630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915b2746-efa1-4bc1-897f-dd3382e94a03", "name": "network-vif-plugged", "status": "completed", "tag": "d5745298-9304-403b-b990-9deaf1756306"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:22.585345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-fc1b8fdb-7445-4eb5-ac2b-797d56c1ea34 req-c689c599-efbf-4f63-80c5-bd75a039a630 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:22.586604 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-fc1b8fdb-7445-4eb5-ac2b-797d56c1ea34 req-c689c599-efbf-4f63-80c5-bd75a039a630 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:22.607891 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-fc1b8fdb-7445-4eb5-ac2b-797d56c1ea34 req-c689c599-efbf-4f63-80c5-bd75a039a630 service nova] Creating event network-vif-plugged:d5745298-9304-403b-b990-9deaf1756306 for instance 915b2746-efa1-4bc1-897f-dd3382e94a03 on hv-cinder-82549 May 26 19:40:22.655264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-fc1b8fdb-7445-4eb5-ac2b-797d56c1ea34 req-c689c599-efbf-4f63-80c5-bd75a039a630 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047401 May 26 19:40:22.655264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 179/368] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:40:23.420899 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:23.422296 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:23.429915 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:23.434796 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:23.434796 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:23.434796 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:23.591941 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:23.605894 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:23.607940 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:23.609345 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-22d645f9-7518-470f-83f6-3517a9a3b95d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.192774 May 26 19:40:23.610041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 190/369] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:23 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:24.631411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:24.632857 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:24.639876 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:24.640436 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:24.641302 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:24.645269 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:24.797879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:24.810173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:24.811586 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:24.813457 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-06e76f8f-5945-49d7-a1fd-f15f7595c4a3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.186934 May 26 19:40:24.816806 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 180/370] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:24 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:25.837520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:25.838345 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:25.848690 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:25.849206 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:25.849905 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:25.850343 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:26.031091 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:26.039986 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:26.043242 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:26.044731 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d4c69d7f-e34b-4954-b690-d42e1495f617 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.212028 May 26 19:40:26.045519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 191/371] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:25 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:27.066816 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:27.068132 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:27.075908 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:27.078801 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:27.079639 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:27.080296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:27.242508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:27.252536 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:27.254451 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:27.255875 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-597fb8e5-d21b-4e88-901e-eed225f1f2ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.193278 May 26 19:40:27.267261 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 181/372] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:27 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:28.275611 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:28.276255 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:28.282840 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:28.283321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:28.284089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:28.284531 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:28.421910 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:28.429891 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:28.432004 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:28.433158 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a879f9a4-7344-4b6a-882a-ffa3e9a6bc5e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.161668 May 26 19:40:28.433756 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 192/373] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:28 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:29.453690 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:29.455381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:29.465405 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:29.466223 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:29.467269 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:29.468104 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:29.630210 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:29.639857 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:29.641687 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:29.642854 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2c49c915-8491-463c-b726-edf04d96584a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.194716 May 26 19:40:29.643609 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 182/374] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:29 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:30.661880 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:30.662504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:30.670223 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:30.670947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:30.671751 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:30.672187 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:30.830222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:30.839178 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:30.840842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:30.842258 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-627193b1-d84c-412a-9af1-c6a1e75e9905 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.184556 May 26 19:40:30.844721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 193/375] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:30 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:31.197570 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-158a28a6-c931-44e1-a55a-c0e384580e54 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "451e1528-abeb-47f3-98f4-db063b508056"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:31.199922 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-158a28a6-c931-44e1-a55a-c0e384580e54 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:31.205388 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-158a28a6-c931-44e1-a55a-c0e384580e54 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:31.205845 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-158a28a6-c931-44e1-a55a-c0e384580e54 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:31.206691 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-158a28a6-c931-44e1-a55a-c0e384580e54 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:31.207353 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-158a28a6-c931-44e1-a55a-c0e384580e54 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:31.861718 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:31.862381 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:31.871341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:31.876179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:31.876179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:31.876179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:31.878662 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:32.002082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:32.010495 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:32.012072 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:32.013220 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-cb6aaef6-4be2-4c3d-a1cb-8950a9df8660 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.155739 May 26 19:40:32.013776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 194/376] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:31 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:40:33.032013 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:33.032646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:33.040108 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:33.041529 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:33.042601 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:33.042795 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:33.173337 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:33.181866 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:33.183880 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:33.185028 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c3de1a7d-8d41-4eff-a81e-e089474cd316 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1740 microversion: 2.20 time: 0.157046 May 26 19:40:33.185574 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 195/377] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:33 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:40:33.701278 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-158a28a6-c931-44e1-a55a-c0e384580e54 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.507829 May 26 19:40:33.701868 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 183/378] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:40:31 2022] POST /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments => generated 194 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:40:34.143661 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-06678f71-c702-4423-8e11-ae973ec19c0c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:34.144156 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-06678f71-c702-4423-8e11-ae973ec19c0c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:34.151441 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-06678f71-c702-4423-8e11-ae973ec19c0c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.152129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-06678f71-c702-4423-8e11-ae973ec19c0c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.154714 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-06678f71-c702-4423-8e11-ae973ec19c0c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.155199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-06678f71-c702-4423-8e11-ae973ec19c0c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.182212 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-06678f71-c702-4423-8e11-ae973ec19c0c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.040556 May 26 19:40:34.182212 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 196/379] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:40:34 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:40:34.193270 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be490104-3881-41b7-8116-52333e23e482"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:34.194472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:34.201752 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.202205 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.203019 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.203459 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:34.203681 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.204063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:34.211394 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.214802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.214802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.214802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.226305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:34.359680 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:34.371758 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:34.372686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:34.373896 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-36518a75-9bd6-4ecf-add9-f136f9048328 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1722 microversion: 2.20 time: 0.174547 May 26 19:40:34.374448 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 197/380] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:34 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:40:34.450331 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Invalid volume: volume be490104-3881-41b7-8116-52333e23e482 is already attached to instances: cee8cee6-5c93-4631-a2c1-f371a167fe97 May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: POST /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3/os-volume_attachments HTTP/1.1 May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 74 May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:40:34.453813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {"volumeAttachment": {"volumeId": "be490104-3881-41b7-8116-52333e23e482"}} May 26 19:40:34.455231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Invalid volume: volume be490104-3881-41b7-8116-52333e23e482 is already attached to instances: cee8cee6-5c93-4631-a2c1-f371a167fe97 May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'server_id': '52eb678d-5cbe-4e95-914d-09d3165544f3', 'body': {'volumeAttachment': {'volumeId': 'be490104-3881-41b7-8116-52333e23e482'}}} May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume be490104-3881-41b7-8116-52333e23e482 is already attached to instances: cee8cee6-5c93-4631-a2c1-f371a167fe97 May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:34.455998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume be490104-3881-41b7-8116-52333e23e482 is already attached to instances: cee8cee6-5c93-4631-a2c1-f371a167fe97 May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:40:34.457165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:40:34.458359 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:40:34.458359 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:40:34.458359 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:40:34.458359 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume be490104-3881-41b7-8116-52333e23e482 is already attached to instances: cee8cee6-5c93-4631-a2c1-f371a167fe97 May 26 19:40:34.458359 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:34.458359 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 400 to user: Invalid volume: volume be490104-3881-41b7-8116-52333e23e482 is already attached to instances: cee8cee6-5c93-4631-a2c1-f371a167fe97 {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:40:34.458359 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-39977a77-4424-4dc0-9156-6431ea31d5a1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.264989 May 26 19:40:34.458359 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 184/381] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:40:34 2022] POST /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3/os-volume_attachments => generated 174 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 19:40:34.463333 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ce9b2a4e-fa23-4b27-b642-061bca33d90d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:34.463844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ce9b2a4e-fa23-4b27-b642-061bca33d90d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:34.470105 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ce9b2a4e-fa23-4b27-b642-061bca33d90d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.470760 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ce9b2a4e-fa23-4b27-b642-061bca33d90d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.471738 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ce9b2a4e-fa23-4b27-b642-061bca33d90d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.472176 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ce9b2a4e-fa23-4b27-b642-061bca33d90d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.503427 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ce9b2a4e-fa23-4b27-b642-061bca33d90d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:40:34.837448 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ce9b2a4e-fa23-4b27-b642-061bca33d90d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 204 len: 0 microversion: 2.1 time: 0.378121 May 26 19:40:34.838594 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 198/382] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:40:34 2022] DELETE /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:40:34.846522 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6133ea4d-fc76-47f6-98d8-124589fa6cca tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:34.847818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6133ea4d-fc76-47f6-98d8-124589fa6cca tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:34.854582 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6133ea4d-fc76-47f6-98d8-124589fa6cca tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.855075 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6133ea4d-fc76-47f6-98d8-124589fa6cca tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.855840 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6133ea4d-fc76-47f6-98d8-124589fa6cca tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:34.856279 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6133ea4d-fc76-47f6-98d8-124589fa6cca tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:34.993792 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6133ea4d-fc76-47f6-98d8-124589fa6cca tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:35.002133 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6133ea4d-fc76-47f6-98d8-124589fa6cca tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1681 microversion: 2.1 time: 0.159315 May 26 19:40:35.002713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 185/383] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:34 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:35.392795 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:35.393510 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:35.399940 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:35.400380 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:35.401125 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:35.401552 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:35.528900 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:35.536717 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:35.538193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:35.539424 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d2a69278-e469-4a3e-884b-8fc9dbf88049 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1722 microversion: 2.20 time: 0.150850 May 26 19:40:35.539970 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 199/384] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:35 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:36.021485 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1f5c8e20-b456-47b5-896f-9398f8c79a2d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:36.022090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1f5c8e20-b456-47b5-896f-9398f8c79a2d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:36.029104 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f5c8e20-b456-47b5-896f-9398f8c79a2d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:36.029554 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f5c8e20-b456-47b5-896f-9398f8c79a2d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:36.030305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f5c8e20-b456-47b5-896f-9398f8c79a2d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:36.030740 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1f5c8e20-b456-47b5-896f-9398f8c79a2d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:36.154922 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1f5c8e20-b456-47b5-896f-9398f8c79a2d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:36.162308 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1f5c8e20-b456-47b5-896f-9398f8c79a2d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1681 microversion: 2.1 time: 0.144718 May 26 19:40:36.166628 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 186/385] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:36 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:36.558403 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:36.559027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:36.565396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:36.565837 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:36.566588 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:36.567046 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:36.693422 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:36.701243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:36.702729 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:36.703888 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-192c862e-e342-4823-acd6-2691e608ba25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1722 microversion: 2.20 time: 0.149899 May 26 19:40:36.704435 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 200/386] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:36 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:37.179986 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a5ca34e8-ed79-4d02-be93-f6c519b2a2e6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:37.180522 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a5ca34e8-ed79-4d02-be93-f6c519b2a2e6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:37.187450 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5ca34e8-ed79-4d02-be93-f6c519b2a2e6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:37.187889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5ca34e8-ed79-4d02-be93-f6c519b2a2e6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:37.188631 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5ca34e8-ed79-4d02-be93-f6c519b2a2e6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:37.189059 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5ca34e8-ed79-4d02-be93-f6c519b2a2e6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:37.317425 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a5ca34e8-ed79-4d02-be93-f6c519b2a2e6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:37.324866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a5ca34e8-ed79-4d02-be93-f6c519b2a2e6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1681 microversion: 2.1 time: 0.148804 May 26 19:40:37.325431 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 187/387] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:37 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:37.721423 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:37.722018 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:37.729065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:37.729507 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:37.730251 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:37.730679 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:37.856744 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:37.869116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:37.872129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:37.874332 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a46f19a5-317c-49c0-90ae-e1af3cfd63b2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1722 microversion: 2.20 time: 0.156462 May 26 19:40:37.875402 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 201/388] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:37 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:38.342493 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-15035a60-07b5-42dc-a503-705e8ceec54c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:38.343120 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-15035a60-07b5-42dc-a503-705e8ceec54c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:38.345577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=38 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:38.350345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-15035a60-07b5-42dc-a503-705e8ceec54c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:38.350764 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-15035a60-07b5-42dc-a503-705e8ceec54c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:38.354740 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-15035a60-07b5-42dc-a503-705e8ceec54c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:38.354740 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-15035a60-07b5-42dc-a503-705e8ceec54c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:38.479213 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-15035a60-07b5-42dc-a503-705e8ceec54c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:38.486696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-15035a60-07b5-42dc-a503-705e8ceec54c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1681 microversion: 2.1 time: 0.148558 May 26 19:40:38.487293 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 188/389] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:38 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:38.604849 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-80c9ab4c-7104-4ebb-84ce-7335f641fd19 req-e7eef30d-e08e-4395-9368-4335f15c593c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915b2746-efa1-4bc1-897f-dd3382e94a03", "name": "network-vif-unplugged", "status": "completed", "tag": "d5745298-9304-403b-b990-9deaf1756306"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:38.613325 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-80c9ab4c-7104-4ebb-84ce-7335f641fd19 req-e7eef30d-e08e-4395-9368-4335f15c593c service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:38.613895 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-80c9ab4c-7104-4ebb-84ce-7335f641fd19 req-e7eef30d-e08e-4395-9368-4335f15c593c service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:38.628586 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-80c9ab4c-7104-4ebb-84ce-7335f641fd19 req-e7eef30d-e08e-4395-9368-4335f15c593c service nova] Creating event network-vif-unplugged:d5745298-9304-403b-b990-9deaf1756306 for instance 915b2746-efa1-4bc1-897f-dd3382e94a03 on hv-cinder-82549 May 26 19:40:38.630615 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-80c9ab4c-7104-4ebb-84ce-7335f641fd19 req-e7eef30d-e08e-4395-9368-4335f15c593c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029408 May 26 19:40:38.631234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 202/390] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:40:38.893646 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:38.894255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:38.900318 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:38.900774 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:38.901541 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:38.901981 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:39.051386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:39.060092 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:39.061728 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:39.062738 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-674f1706-2b8e-4207-a64e-04d9f45fddcb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1722 microversion: 2.20 time: 0.173974 May 26 19:40:39.063399 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 189/391] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:38 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:39.505167 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-41144f54-a9c1-4c96-aea2-851032ca1647 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:39.505852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-41144f54-a9c1-4c96-aea2-851032ca1647 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:39.512233 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-41144f54-a9c1-4c96-aea2-851032ca1647 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:39.512673 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-41144f54-a9c1-4c96-aea2-851032ca1647 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:39.513420 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-41144f54-a9c1-4c96-aea2-851032ca1647 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:39.513850 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-41144f54-a9c1-4c96-aea2-851032ca1647 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:39.646771 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-41144f54-a9c1-4c96-aea2-851032ca1647 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:39.654357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-41144f54-a9c1-4c96-aea2-851032ca1647 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1681 microversion: 2.1 time: 0.153922 May 26 19:40:39.655024 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 203/392] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:39 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:40.081364 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:40.082545 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:40.107581 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:40.107581 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:40.107581 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:40.107581 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:40.405751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:40.422629 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:40.425649 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:40.428103 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5b49e3e0-4754-4b44-bd0b-c99e56a25cff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1725 microversion: 2.20 time: 0.350766 May 26 19:40:40.429325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 190/393] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:40 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1725 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:40.459094 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d7777ed4-6ab2-45d5-b246-eacee1caeaa1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c69f75c7-05d9-47b7-b286-a82a9e8f7a70"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:40.461077 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d7777ed4-6ab2-45d5-b246-eacee1caeaa1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:40.466533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:40.472898 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d7777ed4-6ab2-45d5-b246-eacee1caeaa1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:40.473699 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d7777ed4-6ab2-45d5-b246-eacee1caeaa1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:40.475107 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d7777ed4-6ab2-45d5-b246-eacee1caeaa1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:40.475902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d7777ed4-6ab2-45d5-b246-eacee1caeaa1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:40.671771 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-adcc0b2a-9869-42cc-94c6-c3f7df5081c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:40.672361 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-adcc0b2a-9869-42cc-94c6-c3f7df5081c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:40.679471 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-adcc0b2a-9869-42cc-94c6-c3f7df5081c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:40.680008 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-adcc0b2a-9869-42cc-94c6-c3f7df5081c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:40.680744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-adcc0b2a-9869-42cc-94c6-c3f7df5081c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:40.681229 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-adcc0b2a-9869-42cc-94c6-c3f7df5081c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:40.904778 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-adcc0b2a-9869-42cc-94c6-c3f7df5081c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:40.912459 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-adcc0b2a-9869-42cc-94c6-c3f7df5081c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1681 microversion: 2.1 time: 0.244592 May 26 19:40:40.913041 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 191/394] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:40 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:41.248078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-75805cc9-5950-4e71-acd6-33ee720738ac req-32decea8-5a0d-4e4e-8f29-a63a4bdfe469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52eb678d-5cbe-4e95-914d-09d3165544f3", "name": "network-vif-deleted", "tag": "e87f31d0-2caa-4fb2-aa27-5c69f8daae4e"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:41.258325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-75805cc9-5950-4e71-acd6-33ee720738ac req-32decea8-5a0d-4e4e-8f29-a63a4bdfe469 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:41.259151 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-75805cc9-5950-4e71-acd6-33ee720738ac req-32decea8-5a0d-4e4e-8f29-a63a4bdfe469 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:41.271330 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-75805cc9-5950-4e71-acd6-33ee720738ac req-32decea8-5a0d-4e4e-8f29-a63a4bdfe469 service nova] Creating event network-vif-deleted:e87f31d0-2caa-4fb2-aa27-5c69f8daae4e for instance 52eb678d-5cbe-4e95-914d-09d3165544f3 on hv-cinder-82549 May 26 19:40:41.278660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-75805cc9-5950-4e71-acd6-33ee720738ac req-32decea8-5a0d-4e4e-8f29-a63a4bdfe469 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034597 May 26 19:40:41.279658 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 192/395] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:40:41.694700 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d7777ed4-6ab2-45d5-b246-eacee1caeaa1 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.242899 May 26 19:40:41.695925 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 204/396] 10.222.0.72 () {62 vars in 1363 bytes} [Thu May 26 19:40:40 2022] POST /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments => generated 188 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:40:41.826305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5023fd89-2992-4ad4-a238-e71e7a1de826 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:41.827248 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5023fd89-2992-4ad4-a238-e71e7a1de826 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:41.833876 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5023fd89-2992-4ad4-a238-e71e7a1de826 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:41.834562 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5023fd89-2992-4ad4-a238-e71e7a1de826 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:41.835701 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5023fd89-2992-4ad4-a238-e71e7a1de826 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:41.836141 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5023fd89-2992-4ad4-a238-e71e7a1de826 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:41.930200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:41.930716 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:41.937942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:41.943050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:41.943050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:41.943050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:41.972151 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:41.972600 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:41.973135 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 52eb678d-5cbe-4e95-914d-09d3165544f3 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:40:42.023505 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:42.032353 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8c4acd29-b612-48bc-b441-dbe574dbdc3d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 200 len: 1331 microversion: 2.1 time: 0.106574 May 26 19:40:42.032918 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 205/397] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:41 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:42.098349 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5023fd89-2992-4ad4-a238-e71e7a1de826 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/action" status: 202 len: 0 microversion: 2.20 time: 0.276563 May 26 19:40:42.099179 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 193/398] 10.222.0.72 () {62 vars in 1318 bytes} [Thu May 26 19:40:41 2022] POST /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 19:40:42.107454 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:42.108094 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:42.127237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:42.127692 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:42.128470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:42.128904 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:42.313851 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:42.333364 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:42.335531 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:42.338502 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-48180efc-cfa2-46b9-b59d-7ba3ac00af56 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1751 microversion: 2.20 time: 0.235157 May 26 19:40:42.343696 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 206/399] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:42 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:43.052785 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:43.059135 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:43.062021 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:43.062488 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:43.063302 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:43.063751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:43.084414 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 HTTP/1.1 May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:40:43.086284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:40:43.089190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '52eb678d-5cbe-4e95-914d-09d3165544f3'} May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:40:43.090569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:40:43.092622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:40:43.094143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:40:43.094143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d72d92e6-e8ef-45f5-8c72-51220767e118 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 404 len: 111 microversion: 2.1 time: 0.041976 May 26 19:40:43.094143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 194/400] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:43 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:40:43.098639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f3b19134-2ea9-4564-a0f4-041801964210 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '.version_select at 0x7fa788438940>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:43.212647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f3b19134-2ea9-4564-a0f4-041801964210 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162214640" status: 202 len: 0 microversion: 2.1 time: 0.118075 May 26 19:40:43.213229 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 207/401] 10.222.0.72 () {58 vars in 1220 bytes} [Thu May 26 19:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162214640 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:40:43.362581 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:43.364149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:43.372029 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:43.372616 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:43.373580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:43.374034 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:43.548673 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:43.566669 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:43.568865 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:43.570298 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-886659ab-49b8-4076-aeb2-f3559e33ce3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1751 microversion: 2.20 time: 0.212423 May 26 19:40:43.582539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 195/402] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:43 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:44.490265 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3fdbabb6-107a-4091-8461-11661dd0dd53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:44.491097 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3fdbabb6-107a-4091-8461-11661dd0dd53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:44.516930 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3fdbabb6-107a-4091-8461-11661dd0dd53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:44.516930 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3fdbabb6-107a-4091-8461-11661dd0dd53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:44.516930 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3fdbabb6-107a-4091-8461-11661dd0dd53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:44.516930 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3fdbabb6-107a-4091-8461-11661dd0dd53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:44.517316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1cfc3ad8-b9af-4b9a-9c6d-cb58e03fcd1e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:44.518369 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1cfc3ad8-b9af-4b9a-9c6d-cb58e03fcd1e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:44.531964 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1cfc3ad8-b9af-4b9a-9c6d-cb58e03fcd1e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:44.536042 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1cfc3ad8-b9af-4b9a-9c6d-cb58e03fcd1e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:44.537086 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1cfc3ad8-b9af-4b9a-9c6d-cb58e03fcd1e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:44.537789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1cfc3ad8-b9af-4b9a-9c6d-cb58e03fcd1e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:44.578437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-1cfc3ad8-b9af-4b9a-9c6d-cb58e03fcd1e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lazy-loading 'flavor' on Instance uuid d19b79e3-ce41-4806-b97f-8a14cd797d63 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:40:44.604950 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:44.707122 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-3fdbabb6-107a-4091-8461-11661dd0dd53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'services' on Instance uuid cee8cee6-5c93-4631-a2c1-f371a167fe97 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:40:44.988970 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3fdbabb6-107a-4091-8461-11661dd0dd53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments/be490104-3881-41b7-8116-52333e23e482" status: 202 len: 0 microversion: 2.1 time: 0.502770 May 26 19:40:44.989651 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 208/403] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:40:44 2022] DELETE /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments/be490104-3881-41b7-8116-52333e23e482 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:40:44.999384 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:45.000325 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:45.008018 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:45.008782 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:45.010393 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:45.010832 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:45.013567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1cfc3ad8-b9af-4b9a-9c6d-cb58e03fcd1e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/action" status: 200 len: 32 microversion: 2.1 time: 0.509229 May 26 19:40:45.014661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 196/404] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:40:44 2022] POST /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/action => generated 32 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 19:40:45.030164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-aa9bb0e2-0fb7-4042-bcee-d1770af94ca8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:45.032438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-aa9bb0e2-0fb7-4042-bcee-d1770af94ca8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:45.039143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-aa9bb0e2-0fb7-4042-bcee-d1770af94ca8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:45.039851 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-aa9bb0e2-0fb7-4042-bcee-d1770af94ca8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:45.040660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-aa9bb0e2-0fb7-4042-bcee-d1770af94ca8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:45.041256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-aa9bb0e2-0fb7-4042-bcee-d1770af94ca8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:45.074303 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-aa9bb0e2-0fb7-4042-bcee-d1770af94ca8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058325 May 26 19:40:45.075176 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 197/405] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:40:45 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:40:45.080224 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e9c32ef2-dc93-4619-8837-1368672d2b57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:45.080789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e9c32ef2-dc93-4619-8837-1368672d2b57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:45.086962 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e9c32ef2-dc93-4619-8837-1368672d2b57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:45.088083 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e9c32ef2-dc93-4619-8837-1368672d2b57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:45.088918 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e9c32ef2-dc93-4619-8837-1368672d2b57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:45.090264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e9c32ef2-dc93-4619-8837-1368672d2b57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:45.205723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:45.214920 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:45.216443 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:45.217589 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-84469133-a7ce-480e-88c6-fcd55a3795c2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1753 microversion: 2.20 time: 0.226303 May 26 19:40:45.218326 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 209/406] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:44 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:45.334240 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e9c32ef2-dc93-4619-8837-1368672d2b57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:45.343193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e9c32ef2-dc93-4619-8837-1368672d2b57 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.266758 May 26 19:40:45.343768 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 198/407] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:45 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:46.086478 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5b035b44-481a-49c9-99c5-6f45e71b1e53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:46.087995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5b035b44-481a-49c9-99c5-6f45e71b1e53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:46.094532 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5b035b44-481a-49c9-99c5-6f45e71b1e53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:46.095017 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5b035b44-481a-49c9-99c5-6f45e71b1e53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:46.095778 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5b035b44-481a-49c9-99c5-6f45e71b1e53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:46.096212 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5b035b44-481a-49c9-99c5-6f45e71b1e53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:46.126153 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5b035b44-481a-49c9-99c5-6f45e71b1e53 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 May 26 19:40:46.126721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 210/408] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:40:46 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:40:46.236480 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:46.237080 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:46.243726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:46.244170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:46.244919 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:46.245344 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:46.260553 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:46.360444 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-26a8ce73-d0be-4088-a576-ad1a32045165 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:46.361049 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-26a8ce73-d0be-4088-a576-ad1a32045165 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:46.367536 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-26a8ce73-d0be-4088-a576-ad1a32045165 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:46.367983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-26a8ce73-d0be-4088-a576-ad1a32045165 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:46.368843 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-26a8ce73-d0be-4088-a576-ad1a32045165 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:46.369278 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-26a8ce73-d0be-4088-a576-ad1a32045165 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:46.377845 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:46.387455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:46.389007 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:46.391041 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c2936307-4d70-460e-9084-b222bc2b04f4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.157685 May 26 19:40:46.391041 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 199/409] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:46 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:46.500173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-26a8ce73-d0be-4088-a576-ad1a32045165 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:46.508040 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-26a8ce73-d0be-4088-a576-ad1a32045165 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.151812 May 26 19:40:46.508606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 211/410] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:46 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:47.138227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-34c0642c-e1ac-4256-a656-e70776e834eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:47.139253 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-34c0642c-e1ac-4256-a656-e70776e834eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:47.145534 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34c0642c-e1ac-4256-a656-e70776e834eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.145987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34c0642c-e1ac-4256-a656-e70776e834eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.146756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34c0642c-e1ac-4256-a656-e70776e834eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.147221 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34c0642c-e1ac-4256-a656-e70776e834eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.175943 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-34c0642c-e1ac-4256-a656-e70776e834eb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042151 May 26 19:40:47.176500 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 200/411] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:40:47 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 19:40:47.234977 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-01b21647-81a3-43d9-b383-415ae13508cc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:47.235474 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-01b21647-81a3-43d9-b383-415ae13508cc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:47.242454 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01b21647-81a3-43d9-b383-415ae13508cc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.242925 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01b21647-81a3-43d9-b383-415ae13508cc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.244328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01b21647-81a3-43d9-b383-415ae13508cc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.244764 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01b21647-81a3-43d9-b383-415ae13508cc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.270452 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-01b21647-81a3-43d9-b383-415ae13508cc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:40:47.409225 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:47.409871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:47.416476 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.416936 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.417702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.418444 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.551740 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:47.567124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:47.569090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:47.570472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a4e5f7f1-24db-4ca7-886c-d5ab6fae47dc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.165195 May 26 19:40:47.572245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 201/412] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:47 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:40:47.576886 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ace59667-4528-4ac6-9d1f-62b0a821ac8d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:47.577841 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ace59667-4528-4ac6-9d1f-62b0a821ac8d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:47.584048 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ace59667-4528-4ac6-9d1f-62b0a821ac8d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.584700 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ace59667-4528-4ac6-9d1f-62b0a821ac8d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.589543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ace59667-4528-4ac6-9d1f-62b0a821ac8d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.589543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ace59667-4528-4ac6-9d1f-62b0a821ac8d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.674183 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-01b21647-81a3-43d9-b383-415ae13508cc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 204 len: 0 microversion: 2.1 time: 0.442766 May 26 19:40:47.674778 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 212/413] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:40:47 2022] DELETE /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:40:47.683853 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5b4ba960-01b4-4416-832a-423d7d112eb0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:47.684806 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5b4ba960-01b4-4416-832a-423d7d112eb0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:47.691018 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5b4ba960-01b4-4416-832a-423d7d112eb0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.691690 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5b4ba960-01b4-4416-832a-423d7d112eb0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.692458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5b4ba960-01b4-4416-832a-423d7d112eb0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:47.692889 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5b4ba960-01b4-4416-832a-423d7d112eb0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:47.749897 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ace59667-4528-4ac6-9d1f-62b0a821ac8d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:47.766730 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ace59667-4528-4ac6-9d1f-62b0a821ac8d tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.193253 May 26 19:40:47.767422 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 202/414] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:47 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:47.847027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5b4ba960-01b4-4416-832a-423d7d112eb0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:47.855911 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5b4ba960-01b4-4416-832a-423d7d112eb0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.176300 May 26 19:40:47.856629 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 213/415] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:47 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:48.589540 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:48.590142 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:48.596655 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:48.597122 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:48.597875 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:48.598320 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:48.725782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:48.734738 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:48.736259 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:48.737398 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c96dd57f-f3fd-4538-8483-d4313d47e709 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.151815 May 26 19:40:48.737960 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 203/416] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:48 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:48.784881 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0c4f1e29-74d6-4185-81b0-7581f31dae03 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:48.785487 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0c4f1e29-74d6-4185-81b0-7581f31dae03 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:48.793407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c4f1e29-74d6-4185-81b0-7581f31dae03 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:48.793859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c4f1e29-74d6-4185-81b0-7581f31dae03 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:48.794628 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c4f1e29-74d6-4185-81b0-7581f31dae03 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:48.795097 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c4f1e29-74d6-4185-81b0-7581f31dae03 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:48.873654 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3ce334e5-764b-450e-b28c-2d922cc29cbd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:48.874272 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3ce334e5-764b-450e-b28c-2d922cc29cbd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:48.880373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3ce334e5-764b-450e-b28c-2d922cc29cbd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:48.880823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3ce334e5-764b-450e-b28c-2d922cc29cbd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:48.881586 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3ce334e5-764b-450e-b28c-2d922cc29cbd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:48.882020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3ce334e5-764b-450e-b28c-2d922cc29cbd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:48.924398 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0c4f1e29-74d6-4185-81b0-7581f31dae03 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:48.930762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0c4f1e29-74d6-4185-81b0-7581f31dae03 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.149771 May 26 19:40:48.931299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 214/417] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:48 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:49.015257 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3ce334e5-764b-450e-b28c-2d922cc29cbd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:49.022780 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3ce334e5-764b-450e-b28c-2d922cc29cbd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.153116 May 26 19:40:49.023377 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 204/418] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:48 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:49.760161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:49.760780 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:49.768398 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:49.768839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:49.769903 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:49.770338 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:49.925207 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:49.934244 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:49.935797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:49.936983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b09061e8-aa55-4a5a-929b-4b444f745f64 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.184324 May 26 19:40:49.937535 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 215/419] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:49 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:49.949697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0fd8262a-b4a5-4121-b7a5-2074a7e6d684 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:49.950296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0fd8262a-b4a5-4121-b7a5-2074a7e6d684 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:49.957050 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0fd8262a-b4a5-4121-b7a5-2074a7e6d684 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:49.957487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0fd8262a-b4a5-4121-b7a5-2074a7e6d684 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:49.958254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0fd8262a-b4a5-4121-b7a5-2074a7e6d684 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:49.959942 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0fd8262a-b4a5-4121-b7a5-2074a7e6d684 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:50.040841 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-dcaddf10-0bf4-4b5a-99a0-26fe2cf59e35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:50.041717 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-dcaddf10-0bf4-4b5a-99a0-26fe2cf59e35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:50.048779 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dcaddf10-0bf4-4b5a-99a0-26fe2cf59e35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:50.049216 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dcaddf10-0bf4-4b5a-99a0-26fe2cf59e35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:50.050001 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dcaddf10-0bf4-4b5a-99a0-26fe2cf59e35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:50.050433 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dcaddf10-0bf4-4b5a-99a0-26fe2cf59e35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:50.145235 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0fd8262a-b4a5-4121-b7a5-2074a7e6d684 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:50.157945 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0fd8262a-b4a5-4121-b7a5-2074a7e6d684 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.213022 May 26 19:40:50.158542 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 205/420] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:49 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:50.198718 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-dcaddf10-0bf4-4b5a-99a0-26fe2cf59e35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:50.207306 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-dcaddf10-0bf4-4b5a-99a0-26fe2cf59e35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.170389 May 26 19:40:50.208070 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 216/421] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:50 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:50.956665 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:50.957605 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:50.964263 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:50.964721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:50.965613 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:50.966051 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:51.103664 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:51.112673 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:51.114169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:51.115398 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7fab251e-165a-4fb6-906e-94f09682777f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.162769 May 26 19:40:51.126197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 206/422] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:50 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:51.175101 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c79f1cd5-4830-4112-b72e-edf2e5928885 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:51.175705 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c79f1cd5-4830-4112-b72e-edf2e5928885 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:51.182610 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c79f1cd5-4830-4112-b72e-edf2e5928885 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:51.183101 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c79f1cd5-4830-4112-b72e-edf2e5928885 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:51.183870 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c79f1cd5-4830-4112-b72e-edf2e5928885 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:51.184475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c79f1cd5-4830-4112-b72e-edf2e5928885 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:51.225904 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8785782c-a26f-44fe-98a7-a594414443a6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:51.226442 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8785782c-a26f-44fe-98a7-a594414443a6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:51.233611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8785782c-a26f-44fe-98a7-a594414443a6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:51.234066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8785782c-a26f-44fe-98a7-a594414443a6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:51.235018 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8785782c-a26f-44fe-98a7-a594414443a6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:51.235462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8785782c-a26f-44fe-98a7-a594414443a6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:51.339085 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c79f1cd5-4830-4112-b72e-edf2e5928885 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:51.349295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c79f1cd5-4830-4112-b72e-edf2e5928885 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.177964 May 26 19:40:51.350948 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 217/423] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:51 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:51.393247 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8785782c-a26f-44fe-98a7-a594414443a6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:51.401754 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8785782c-a26f-44fe-98a7-a594414443a6 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.180006 May 26 19:40:51.411824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 207/424] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:51 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:52.133650 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:52.134799 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:52.141425 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:52.141879 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:52.142650 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:52.143120 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:52.304439 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:52.313814 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:52.315469 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:52.316926 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0306b5c9-d1e8-442d-be8d-9a3634ab2547 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.187318 May 26 19:40:52.317556 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 218/425] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:52 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:52.367185 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-60bd6062-0d30-405b-9a98-d9e538b43594 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:52.367965 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-60bd6062-0d30-405b-9a98-d9e538b43594 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:52.376278 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-60bd6062-0d30-405b-9a98-d9e538b43594 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:52.376732 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-60bd6062-0d30-405b-9a98-d9e538b43594 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:52.377506 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-60bd6062-0d30-405b-9a98-d9e538b43594 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:52.377942 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-60bd6062-0d30-405b-9a98-d9e538b43594 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:52.418741 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2fb6d864-72a9-4463-9e44-022b860db44f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:52.419375 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2fb6d864-72a9-4463-9e44-022b860db44f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:52.435770 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2fb6d864-72a9-4463-9e44-022b860db44f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:52.436228 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2fb6d864-72a9-4463-9e44-022b860db44f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:52.437050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2fb6d864-72a9-4463-9e44-022b860db44f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:52.437482 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2fb6d864-72a9-4463-9e44-022b860db44f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:52.535179 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-60bd6062-0d30-405b-9a98-d9e538b43594 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:52.551713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-60bd6062-0d30-405b-9a98-d9e538b43594 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.188564 May 26 19:40:52.552480 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 208/426] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:52 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:52.588990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2fb6d864-72a9-4463-9e44-022b860db44f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:52.597781 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2fb6d864-72a9-4463-9e44-022b860db44f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.183335 May 26 19:40:52.599116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 219/427] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:52 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:53.336633 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:53.337752 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:53.343971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:53.344429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:53.345199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:53.345634 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:53.494699 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:53.504294 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:53.505962 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:53.507379 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-888dfaac-7074-4f03-99df-2720e764ae27 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.174720 May 26 19:40:53.508711 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 209/428] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:53 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:53.569568 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-dd15d6d0-a3a8-4ce4-a2b5-413d7a5960ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:53.570839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-dd15d6d0-a3a8-4ce4-a2b5-413d7a5960ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:53.578123 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dd15d6d0-a3a8-4ce4-a2b5-413d7a5960ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:53.583159 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dd15d6d0-a3a8-4ce4-a2b5-413d7a5960ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:53.583159 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dd15d6d0-a3a8-4ce4-a2b5-413d7a5960ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:53.583159 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dd15d6d0-a3a8-4ce4-a2b5-413d7a5960ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:53.616472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c701e579-3dea-42de-8f52-2df400244dea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:53.617459 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c701e579-3dea-42de-8f52-2df400244dea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:53.624139 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c701e579-3dea-42de-8f52-2df400244dea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:53.625243 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c701e579-3dea-42de-8f52-2df400244dea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:53.626265 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c701e579-3dea-42de-8f52-2df400244dea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:53.626967 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c701e579-3dea-42de-8f52-2df400244dea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:53.745067 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-dd15d6d0-a3a8-4ce4-a2b5-413d7a5960ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:53.754979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-dd15d6d0-a3a8-4ce4-a2b5-413d7a5960ad tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.189320 May 26 19:40:53.765515 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 220/429] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:53 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:53.783200 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c701e579-3dea-42de-8f52-2df400244dea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:53.791720 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c701e579-3dea-42de-8f52-2df400244dea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.179534 May 26 19:40:53.792295 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 210/430] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:53 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:54.533721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:54.535193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:54.542162 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:54.542610 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:54.543412 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:54.543852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:54.688160 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:54.697009 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:54.698838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:54.700023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4c29d7c1-7a9e-485f-a861-772703298729 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.173496 May 26 19:40:54.700997 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 221/431] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:54 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:54.772521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0f6f3d43-743a-42ea-afe1-811862f45bb2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:54.773113 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0f6f3d43-743a-42ea-afe1-811862f45bb2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:54.780103 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0f6f3d43-743a-42ea-afe1-811862f45bb2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:54.780552 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0f6f3d43-743a-42ea-afe1-811862f45bb2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:54.781309 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0f6f3d43-743a-42ea-afe1-811862f45bb2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:54.781742 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0f6f3d43-743a-42ea-afe1-811862f45bb2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:54.810264 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b42d6cef-623e-44fb-b300-10aefa2c4432 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:54.811240 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b42d6cef-623e-44fb-b300-10aefa2c4432 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:54.818487 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b42d6cef-623e-44fb-b300-10aefa2c4432 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:54.819234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b42d6cef-623e-44fb-b300-10aefa2c4432 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:54.820019 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b42d6cef-623e-44fb-b300-10aefa2c4432 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:54.820455 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b42d6cef-623e-44fb-b300-10aefa2c4432 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:54.850722 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:54.961777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0f6f3d43-743a-42ea-afe1-811862f45bb2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:54.971893 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0f6f3d43-743a-42ea-afe1-811862f45bb2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.203155 May 26 19:40:54.972470 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 211/432] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:54 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:54.985957 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b42d6cef-623e-44fb-b300-10aefa2c4432 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:54.994498 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b42d6cef-623e-44fb-b300-10aefa2c4432 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.188668 May 26 19:40:54.998953 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 222/433] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:54 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:55.718860 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:55.719422 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:55.725931 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:55.726487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:55.727356 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:55.728032 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:55.870240 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:55.882339 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:55.885190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:55.893433 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0fba52f3-756e-4183-9dd4-98773ec59254 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.171769 May 26 19:40:55.893433 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 212/434] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:55 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:40:55.991250 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d2d2e3b1-6f6d-4bc1-996e-3834327bb1be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:55.991876 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d2d2e3b1-6f6d-4bc1-996e-3834327bb1be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:56.000939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d2d2e3b1-6f6d-4bc1-996e-3834327bb1be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:56.002006 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d2d2e3b1-6f6d-4bc1-996e-3834327bb1be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:56.003254 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d2d2e3b1-6f6d-4bc1-996e-3834327bb1be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:56.003892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d2d2e3b1-6f6d-4bc1-996e-3834327bb1be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:56.012560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2124a618-93d0-48f0-89b1-45dce43c9c81 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:56.013172 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2124a618-93d0-48f0-89b1-45dce43c9c81 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:56.019210 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2124a618-93d0-48f0-89b1-45dce43c9c81 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:56.019654 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2124a618-93d0-48f0-89b1-45dce43c9c81 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:56.020474 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2124a618-93d0-48f0-89b1-45dce43c9c81 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:56.020971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2124a618-93d0-48f0-89b1-45dce43c9c81 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:56.179776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d2d2e3b1-6f6d-4bc1-996e-3834327bb1be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:56.188378 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d2d2e3b1-6f6d-4bc1-996e-3834327bb1be tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.202266 May 26 19:40:56.188960 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 223/435] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:55 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:56.194192 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2124a618-93d0-48f0-89b1-45dce43c9c81 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:56.202089 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2124a618-93d0-48f0-89b1-45dce43c9c81 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.193299 May 26 19:40:56.202677 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 213/436] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:56 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:56.905799 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:56.906408 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:56.912809 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:56.913265 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:56.914051 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:56.914493 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:57.053426 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:57.062531 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:57.064054 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:57.065516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f6226530-a823-480c-bf93-4ff28ed1bb8f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.163715 May 26 19:40:57.066537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 224/437] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:56 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:57.205516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a1ce8bfd-32df-43c6-a93c-78c9d68cfd52 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:57.206122 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a1ce8bfd-32df-43c6-a93c-78c9d68cfd52 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:57.212997 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1ce8bfd-32df-43c6-a93c-78c9d68cfd52 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:57.213455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1ce8bfd-32df-43c6-a93c-78c9d68cfd52 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:57.214318 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1ce8bfd-32df-43c6-a93c-78c9d68cfd52 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:57.214770 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a1ce8bfd-32df-43c6-a93c-78c9d68cfd52 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:57.220516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8b8c5acd-91cd-4cfb-ac61-4116dedecc7f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:57.221210 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8b8c5acd-91cd-4cfb-ac61-4116dedecc7f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:57.227460 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b8c5acd-91cd-4cfb-ac61-4116dedecc7f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:57.227903 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b8c5acd-91cd-4cfb-ac61-4116dedecc7f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:57.228659 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b8c5acd-91cd-4cfb-ac61-4116dedecc7f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:57.229084 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b8c5acd-91cd-4cfb-ac61-4116dedecc7f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:57.348005 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a1ce8bfd-32df-43c6-a93c-78c9d68cfd52 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:57.356263 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a1ce8bfd-32df-43c6-a93c-78c9d68cfd52 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.154592 May 26 19:40:57.357305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 214/438] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:57 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:57.363968 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8b8c5acd-91cd-4cfb-ac61-4116dedecc7f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:57.372367 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8b8c5acd-91cd-4cfb-ac61-4116dedecc7f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.155631 May 26 19:40:57.372935 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 225/439] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:57 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:58.093085 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:58.093616 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:58.099716 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:58.100168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:58.100930 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:58.101371 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:58.230473 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:58.238859 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:58.240389 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:58.241803 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6f3e7185-5b9a-49e1-b671-fe73753e844a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.153210 May 26 19:40:58.242362 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 215/440] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:58 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:58.373670 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0ad8cc87-ff1e-46b7-833b-49eee4b1702a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:58.374281 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0ad8cc87-ff1e-46b7-833b-49eee4b1702a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:58.380843 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0ad8cc87-ff1e-46b7-833b-49eee4b1702a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:58.381288 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0ad8cc87-ff1e-46b7-833b-49eee4b1702a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:58.382083 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0ad8cc87-ff1e-46b7-833b-49eee4b1702a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:58.382516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0ad8cc87-ff1e-46b7-833b-49eee4b1702a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:58.389788 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e82ba272-864b-467e-ba29-4005224df1ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:58.390392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e82ba272-864b-467e-ba29-4005224df1ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:58.396274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e82ba272-864b-467e-ba29-4005224df1ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:58.396718 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e82ba272-864b-467e-ba29-4005224df1ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:58.397469 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e82ba272-864b-467e-ba29-4005224df1ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:58.397899 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e82ba272-864b-467e-ba29-4005224df1ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:58.402428 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=100 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:58.512075 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0ad8cc87-ff1e-46b7-833b-49eee4b1702a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:58.520110 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0ad8cc87-ff1e-46b7-833b-49eee4b1702a tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.150254 May 26 19:40:58.520683 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 226/441] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:58 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:40:58.528298 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e82ba272-864b-467e-ba29-4005224df1ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:58.535742 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e82ba272-864b-467e-ba29-4005224df1ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1683 microversion: 2.1 time: 0.149778 May 26 19:40:58.536296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 216/442] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:58 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:59.260131 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:59.260681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:59.266892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:59.267369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:59.268135 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:59.268593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:59.409364 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:59.418614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:59.420147 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:59.421312 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-364f5d6f-d159-4c06-b781-7f674b7f3c6a tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.165238 May 26 19:40:59.421868 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 227/443] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:40:59 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:40:59.487876 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-128f1600-1697-48b5-aa96-eadc2a6ac7ef req-8f7e3c33-0123-4263-bcf4-262aa07f6279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee8cee6-5c93-4631-a2c1-f371a167fe97", "name": "network-vif-deleted", "tag": "bb441dd0-8885-4c02-8728-1c89ea5d6a61"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:40:59.497121 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-128f1600-1697-48b5-aa96-eadc2a6ac7ef req-8f7e3c33-0123-4263-bcf4-262aa07f6279 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:59.497650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-128f1600-1697-48b5-aa96-eadc2a6ac7ef req-8f7e3c33-0123-4263-bcf4-262aa07f6279 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:59.508691 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-128f1600-1697-48b5-aa96-eadc2a6ac7ef req-8f7e3c33-0123-4263-bcf4-262aa07f6279 service nova] Creating event network-vif-deleted:bb441dd0-8885-4c02-8728-1c89ea5d6a61 for instance cee8cee6-5c93-4631-a2c1-f371a167fe97 on hv-cinder-82549 May 26 19:40:59.513976 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-128f1600-1697-48b5-aa96-eadc2a6ac7ef req-8f7e3c33-0123-4263-bcf4-262aa07f6279 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029711 May 26 19:40:59.514508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 217/444] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:40:59.537267 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a72a6f9d-41ae-4cb4-8f8c-fdd67be4fe3f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:59.538122 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a72a6f9d-41ae-4cb4-8f8c-fdd67be4fe3f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:59.545537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a72a6f9d-41ae-4cb4-8f8c-fdd67be4fe3f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:59.546011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a72a6f9d-41ae-4cb4-8f8c-fdd67be4fe3f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:59.546779 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a72a6f9d-41ae-4cb4-8f8c-fdd67be4fe3f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:59.547262 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a72a6f9d-41ae-4cb4-8f8c-fdd67be4fe3f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:59.554000 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fc7ebc48-96e3-497a-b59c-5f49abe0936a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:40:59.559440 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fc7ebc48-96e3-497a-b59c-5f49abe0936a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:40:59.566630 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fc7ebc48-96e3-497a-b59c-5f49abe0936a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:59.567340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fc7ebc48-96e3-497a-b59c-5f49abe0936a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:59.568295 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fc7ebc48-96e3-497a-b59c-5f49abe0936a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:40:59.568904 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fc7ebc48-96e3-497a-b59c-5f49abe0936a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:40:59.644518 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fc7ebc48-96e3-497a-b59c-5f49abe0936a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:59.653613 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fc7ebc48-96e3-497a-b59c-5f49abe0936a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1615 microversion: 2.1 time: 0.104410 May 26 19:40:59.654416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 218/445] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:59 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1615 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:40:59.700637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a72a6f9d-41ae-4cb4-8f8c-fdd67be4fe3f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:40:59.709321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a72a6f9d-41ae-4cb4-8f8c-fdd67be4fe3f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.175912 May 26 19:40:59.710189 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 228/446] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:40:59 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:41:00.440826 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:00.441574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:00.448219 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:00.448672 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:00.449426 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:00.449868 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:00.580508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:00.590453 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:00.592152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:00.593319 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-abbc7f1c-c4fe-4352-8172-2ad0365054a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.156402 May 26 19:41:00.593879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 219/447] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:00 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:00.670021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:00.670621 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:00.677088 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:00.677578 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:00.678367 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:00.678862 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:00.711936 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:00.712379 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:00.713391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid cee8cee6-5c93-4631-a2c1-f371a167fe97 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:41:00.727373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3801abd1-10ae-4a8f-b259-6b04e620441b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:00.727974 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3801abd1-10ae-4a8f-b259-6b04e620441b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:00.734489 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3801abd1-10ae-4a8f-b259-6b04e620441b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:00.734962 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3801abd1-10ae-4a8f-b259-6b04e620441b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:00.735931 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3801abd1-10ae-4a8f-b259-6b04e620441b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:00.736365 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3801abd1-10ae-4a8f-b259-6b04e620441b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:00.760641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:00.768440 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8cb83252-fd8a-47e6-a009-804e9601e1fb tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 200 len: 1331 microversion: 2.1 time: 0.102225 May 26 19:41:00.769225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 229/448] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:00 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:00.897402 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3801abd1-10ae-4a8f-b259-6b04e620441b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:00.905271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3801abd1-10ae-4a8f-b259-6b04e620441b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1736 microversion: 2.1 time: 0.181769 May 26 19:41:00.905861 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 220/449] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:00 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:41:01.611906 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:01.612529 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:01.619473 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:01.622383 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:01.622383 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:01.622383 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:01.752544 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:01.761848 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:01.763494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:01.764658 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a1f69cfa-4bb0-4186-8390-69a2bc4866c5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.157012 May 26 19:41:01.765452 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 230/450] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:01 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:01.785493 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:01.786093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:01.793293 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:01.793738 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:01.794490 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:01.794936 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:01.808461 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 HTTP/1.1 May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:41:01.810090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:41:01.811890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'cee8cee6-5c93-4631-a2c1-f371a167fe97'} May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:41:01.812824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:41:01.814314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:41:01.815940 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:41:01.815940 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-60819894-89b8-4d8a-bef6-4d0213dc6a1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 404 len: 111 microversion: 2.1 time: 0.029853 May 26 19:41:01.815940 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 221/451] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:01 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:41:01.820307 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-44226557-1b5a-4722-86c2-b5cae652d35d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '.version_select at 0x7fa7882260d0>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:01.927374 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d4fdff50-0242-4449-92d9-3d7c73272c24 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:01.927897 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d4fdff50-0242-4449-92d9-3d7c73272c24 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:01.935966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d4fdff50-0242-4449-92d9-3d7c73272c24 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:01.936736 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d4fdff50-0242-4449-92d9-3d7c73272c24 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:01.938050 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d4fdff50-0242-4449-92d9-3d7c73272c24 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:01.938754 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d4fdff50-0242-4449-92d9-3d7c73272c24 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:01.952845 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-44226557-1b5a-4722-86c2-b5cae652d35d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437929174" status: 202 len: 0 microversion: 2.1 time: 0.136358 May 26 19:41:01.956993 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 231/452] 10.222.0.72 () {58 vars in 1217 bytes} [Thu May 26 19:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437929174 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:41:02.074878 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d4fdff50-0242-4449-92d9-3d7c73272c24 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:02.082836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d4fdff50-0242-4449-92d9-3d7c73272c24 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1716 microversion: 2.1 time: 0.159491 May 26 19:41:02.083454 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 222/453] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:01 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:02.214626 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:02.215255 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:02.227994 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:02.229156 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:02.229977 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:02.230413 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:02.319280 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] HTTP exception thrown: Cannot 'detach_volume' instance d19b79e3-ce41-4806-b97f-8a14cd797d63 while it is in vm_state rescued May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Request method failure captured: May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments/451e1528-abeb-47f3-98f4-db063b508056 HTTP/1.1 May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bk-wWCrmDu3OZPPjGfGavhx6ia2Eyb0y9MeDKXOg5P9P_grBQpBxNjv2BirTX3fBsSVTAVkwePvf99LDpsNyrGPxHS5r2J07Cyp_VAt50gwM4c42wDr0Kb3F0ETLaB9On5ikFz8URDxONdpFnJS2OXZ7NgZiRJLg7Vui1vzIRTa2E May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:41:02.321259 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bf99d88fec9046608e464a5e2c75506e", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 9a0e96324450438699abfcefec6d1a6d May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:41:02.322784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Cannot 'detach_volume' instance d19b79e3-ce41-4806-b97f-8a14cd797d63 while it is in vm_state rescued May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'server_id': 'd19b79e3-ce41-4806-b97f-8a14cd797d63', 'id': '451e1528-abeb-47f3-98f4-db063b508056'} May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d19b79e3-ce41-4806-b97f-8a14cd797d63 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:41:02.324146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d19b79e3-ce41-4806-b97f-8a14cd797d63 while it is in vm_state rescued May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d19b79e3-ce41-4806-b97f-8a14cd797d63 while it is in vm_state rescued May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:02.325533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Returning 409 to user: Cannot 'detach_volume' instance d19b79e3-ce41-4806-b97f-8a14cd797d63 while it is in vm_state rescued {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:41:02.327358 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-91ac746b-5980-4dbd-b077-2a14d0a52cfb tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments/451e1528-abeb-47f3-98f4-db063b508056" status: 409 len: 152 microversion: 2.1 time: 0.113533 May 26 19:41:02.327793 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 232/454] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:41:02 2022] DELETE /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments/451e1528-abeb-47f3-98f4-db063b508056 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 19:41:02.334141 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ab693d69-ae72-4eb4-8f68-e33be8414d9c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:02.340820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ab693d69-ae72-4eb4-8f68-e33be8414d9c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:02.341096 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ab693d69-ae72-4eb4-8f68-e33be8414d9c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:02.341543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ab693d69-ae72-4eb4-8f68-e33be8414d9c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:02.342295 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ab693d69-ae72-4eb4-8f68-e33be8414d9c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:02.342729 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ab693d69-ae72-4eb4-8f68-e33be8414d9c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:02.574441 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ab693d69-ae72-4eb4-8f68-e33be8414d9c tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "POST /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/action" status: 202 len: 0 microversion: 2.1 time: 0.244013 May 26 19:41:02.575107 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 223/455] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:41:02 2022] POST /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:41:02.583085 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2319679d-5b79-4c92-b782-e88fb5e8a8dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:02.583834 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2319679d-5b79-4c92-b782-e88fb5e8a8dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:02.590449 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2319679d-5b79-4c92-b782-e88fb5e8a8dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:02.590928 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2319679d-5b79-4c92-b782-e88fb5e8a8dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:02.591729 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2319679d-5b79-4c92-b782-e88fb5e8a8dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:02.592165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2319679d-5b79-4c92-b782-e88fb5e8a8dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:02.734680 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2319679d-5b79-4c92-b782-e88fb5e8a8dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:02.740284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2319679d-5b79-4c92-b782-e88fb5e8a8dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1724 microversion: 2.1 time: 0.160950 May 26 19:41:02.741120 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 233/456] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:02 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:02.742958 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-337765bf-1d02-4c59-a276-d230452c0aa8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: .version_select at 0x7fa78840e3a0>, body: {"keypair": {"name": "tempest-keypair-884081685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELAfXEmJequPBwOCZ1zZoatf4va7oi3Z2XKcU3MZlJayxs4JTkhpBbYUGYOmHIgWJu79fuXr+oQKzITwtF6MQ5ZwJXLBg6HSjRMbdr3vcWn4ovTf4Dkjz6mm7u5b6N9gg=="}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:02.756608 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-337765bf-1d02-4c59-a276-d230452c0aa8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:41:02.761152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-337765bf-1d02-4c59-a276-d230452c0aa8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for user 841abe37b81f47d2a95140e46b12ea08 and project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:41:02.783450 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:02.784052 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:02.793871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:02.793871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:02.793871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:02.793871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:02.845104 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-337765bf-1d02-4c59-a276-d230452c0aa8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108125 May 26 19:41:02.846007 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 224/457] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:41:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:41:02.927280 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:02.936123 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:02.937764 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:02.939002 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1859b0f9-8d11-448c-b2e9-0edb1c8952ba tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.160137 May 26 19:41:02.939582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 234/458] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:02 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:41:03.758194 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-01fe08cb-2b81-4aeb-a8b1-75b2ae1d13c3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:03.758938 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-01fe08cb-2b81-4aeb-a8b1-75b2ae1d13c3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:03.765241 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-01fe08cb-2b81-4aeb-a8b1-75b2ae1d13c3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:03.765695 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-01fe08cb-2b81-4aeb-a8b1-75b2ae1d13c3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:03.766455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-01fe08cb-2b81-4aeb-a8b1-75b2ae1d13c3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:03.766891 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-01fe08cb-2b81-4aeb-a8b1-75b2ae1d13c3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:03.900822 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-01fe08cb-2b81-4aeb-a8b1-75b2ae1d13c3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:03.909014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-01fe08cb-2b81-4aeb-a8b1-75b2ae1d13c3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1724 microversion: 2.1 time: 0.154663 May 26 19:41:03.909494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 225/459] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:03 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:03.957735 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:03.958334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:03.967391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:03.967518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:03.968185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:03.968642 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:04.096531 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:04.105696 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:04.108405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:04.108405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-50ee86a4-c1d7-4b2c-a4b1-1a0ebc1bbf39 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.154670 May 26 19:41:04.108916 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 235/460] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:03 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:04.926415 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-46655a3e-218e-4c4e-99e7-616df9d56b18 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:04.927086 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-46655a3e-218e-4c4e-99e7-616df9d56b18 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:04.934083 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46655a3e-218e-4c4e-99e7-616df9d56b18 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:04.934532 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46655a3e-218e-4c4e-99e7-616df9d56b18 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:04.935316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46655a3e-218e-4c4e-99e7-616df9d56b18 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:04.935748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46655a3e-218e-4c4e-99e7-616df9d56b18 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:05.126104 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:05.126715 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:05.133236 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:05.133687 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:05.134484 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:05.134941 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:05.150770 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-46655a3e-218e-4c4e-99e7-616df9d56b18 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:05.158698 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-46655a3e-218e-4c4e-99e7-616df9d56b18 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1724 microversion: 2.1 time: 0.236223 May 26 19:41:05.159302 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 226/461] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:04 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:05.264055 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:05.272662 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:05.274162 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:05.275890 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5efce65c-5d99-45c8-979c-bf4521d8415e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.153336 May 26 19:41:05.276446 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 236/462] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:05 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:41:05.301558 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-880970546", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ddf1778-5518-469d-acdc-1047098dc517"}], "security_groups": [{"name": "tempest-securitygroup--1163876111"}], "key_name": "tempest-keypair-884081685", "user_data": "}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:05.410001 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] validate_networks() for [('2ddf1778-5518-469d-acdc-1047098dc517', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:41:05.776620 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:41:05.777043 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:41:05.777524 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:41:05.777935 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:41:05.778349 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:41:05.787321 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:05.793580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:05.793580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:05.793580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:05.805187 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:41:05.809166 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for user 841abe37b81f47d2a95140e46b12ea08 and project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:41:05.811574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:05.820952 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:41:05.823753 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:41:05.942287 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e66ccedc-2acd-4f81-bad7-a18eb37e24d9 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.645063 May 26 19:41:05.942999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 227/463] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:41:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:41:05.953475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c77be6d3-615e-44cf-a79c-b4c928e2aa56 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:05.954156 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c77be6d3-615e-44cf-a79c-b4c928e2aa56 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:06.013609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c77be6d3-615e-44cf-a79c-b4c928e2aa56 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:06.020878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c77be6d3-615e-44cf-a79c-b4c928e2aa56 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1240 microversion: 2.1 time: 0.071224 May 26 19:41:06.021435 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 237/464] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:05 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:06.177036 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-eaed7492-6a51-495e-b57d-a2047dea381b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:06.177658 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-eaed7492-6a51-495e-b57d-a2047dea381b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:06.184715 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eaed7492-6a51-495e-b57d-a2047dea381b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:06.185163 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eaed7492-6a51-495e-b57d-a2047dea381b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:06.185918 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eaed7492-6a51-495e-b57d-a2047dea381b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:06.187239 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eaed7492-6a51-495e-b57d-a2047dea381b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:06.295004 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:06.296392 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:06.302269 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:06.302720 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:06.303518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:06.303951 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:06.329059 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-eaed7492-6a51-495e-b57d-a2047dea381b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:06.337485 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-eaed7492-6a51-495e-b57d-a2047dea381b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1730 microversion: 2.1 time: 0.164879 May 26 19:41:06.338142 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 228/465] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:06 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:06.359656 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c845e4be-37cf-4f8a-b285-3afa93dac829 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:06.360423 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c845e4be-37cf-4f8a-b285-3afa93dac829 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:06.367676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c845e4be-37cf-4f8a-b285-3afa93dac829 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:06.368176 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c845e4be-37cf-4f8a-b285-3afa93dac829 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:06.369187 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c845e4be-37cf-4f8a-b285-3afa93dac829 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:06.369787 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c845e4be-37cf-4f8a-b285-3afa93dac829 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:06.444737 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:06.452799 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c845e4be-37cf-4f8a-b285-3afa93dac829 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099221 May 26 19:41:06.453551 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 229/466] 10.222.0.72 () {58 vars in 1274 bytes} [Thu May 26 19:41:06 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:41:06.459748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:06.459748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:06.459748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-57921d9d-ce73-4ec0-830b-9137a757f880 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.168814 May 26 19:41:06.460375 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 238/467] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:06 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:41:07.037689 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ad4bc0cb-ba51-424c-99db-6ea78aada57b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:07.038290 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ad4bc0cb-ba51-424c-99db-6ea78aada57b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:07.045052 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad4bc0cb-ba51-424c-99db-6ea78aada57b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:07.045483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad4bc0cb-ba51-424c-99db-6ea78aada57b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:07.046287 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad4bc0cb-ba51-424c-99db-6ea78aada57b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:07.046720 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad4bc0cb-ba51-424c-99db-6ea78aada57b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:07.127541 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ad4bc0cb-ba51-424c-99db-6ea78aada57b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:07.134854 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ad4bc0cb-ba51-424c-99db-6ea78aada57b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1236 microversion: 2.1 time: 0.101027 May 26 19:41:07.135441 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 239/468] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:07 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1236 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:07.477247 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:07.477848 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:07.484469 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:07.484991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:07.485745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:07.486178 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:07.705162 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:07.714926 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:07.716483 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:07.717640 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-af62b5e9-f84c-4672-a7f1-8995b976a1f8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.244893 May 26 19:41:07.718206 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 230/469] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:07 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:07.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-21455640-7c57-4120-bcab-568153632e38 req-71414533-6c1d-48db-ae63-23a77c984099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19b79e3-ce41-4806-b97f-8a14cd797d63", "tag": "e6b42048-c3ab-4c39-bdb2-eab21f5b42e7"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:07.809108 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-21455640-7c57-4120-bcab-568153632e38 req-71414533-6c1d-48db-ae63-23a77c984099 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:07.809547 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-21455640-7c57-4120-bcab-568153632e38 req-71414533-6c1d-48db-ae63-23a77c984099 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:07.820927 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-21455640-7c57-4120-bcab-568153632e38 req-71414533-6c1d-48db-ae63-23a77c984099 service nova] Creating event network-changed:e6b42048-c3ab-4c39-bdb2-eab21f5b42e7 for instance d19b79e3-ce41-4806-b97f-8a14cd797d63 on hv-cinder-82549 May 26 19:41:07.826485 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-21455640-7c57-4120-bcab-568153632e38 req-71414533-6c1d-48db-ae63-23a77c984099 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029497 May 26 19:41:07.827407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 240/470] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:41:08.156155 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ef2d0dca-d2b7-4518-85d8-6eddbdbfc2b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:08.156919 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ef2d0dca-d2b7-4518-85d8-6eddbdbfc2b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:08.163266 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef2d0dca-d2b7-4518-85d8-6eddbdbfc2b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:08.163876 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef2d0dca-d2b7-4518-85d8-6eddbdbfc2b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:08.164756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef2d0dca-d2b7-4518-85d8-6eddbdbfc2b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:08.165289 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef2d0dca-d2b7-4518-85d8-6eddbdbfc2b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:08.262731 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ef2d0dca-d2b7-4518-85d8-6eddbdbfc2b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:08.272677 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ef2d0dca-d2b7-4518-85d8-6eddbdbfc2b7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1310 microversion: 2.1 time: 0.121025 May 26 19:41:08.273830 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 231/471] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:08 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1310 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:41:08.736968 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:08.737684 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:08.749185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:08.749639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:08.750425 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:08.752441 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:08.777526 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=100 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:08.900076 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:08.908473 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:08.909962 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:08.911131 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5e1b3e78-6733-4345-a423-dc2447dd5add tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.178672 May 26 19:41:08.911687 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 241/472] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:08 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:09.292460 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6744d609-9a21-4342-961d-64dcb12769c0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:09.298224 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6744d609-9a21-4342-961d-64dcb12769c0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:09.300809 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6744d609-9a21-4342-961d-64dcb12769c0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:09.301259 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6744d609-9a21-4342-961d-64dcb12769c0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:09.302022 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6744d609-9a21-4342-961d-64dcb12769c0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:09.302473 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6744d609-9a21-4342-961d-64dcb12769c0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:09.551700 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6744d609-9a21-4342-961d-64dcb12769c0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:09.559390 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6744d609-9a21-4342-961d-64dcb12769c0 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1366 microversion: 2.1 time: 0.272426 May 26 19:41:09.562972 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 232/473] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:09 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:09.851060 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-e2d3ebb7-4931-4ad0-ba46-47ceb116b757 req-44c0031e-bd60-4f2a-93df-1bd1a46539cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19b79e3-ce41-4806-b97f-8a14cd797d63", "tag": "e6b42048-c3ab-4c39-bdb2-eab21f5b42e7"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:09.862991 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-e2d3ebb7-4931-4ad0-ba46-47ceb116b757 req-44c0031e-bd60-4f2a-93df-1bd1a46539cb service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:09.863702 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-e2d3ebb7-4931-4ad0-ba46-47ceb116b757 req-44c0031e-bd60-4f2a-93df-1bd1a46539cb service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:09.877806 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-e2d3ebb7-4931-4ad0-ba46-47ceb116b757 req-44c0031e-bd60-4f2a-93df-1bd1a46539cb service nova] Creating event network-changed:e6b42048-c3ab-4c39-bdb2-eab21f5b42e7 for instance d19b79e3-ce41-4806-b97f-8a14cd797d63 on hv-cinder-82549 May 26 19:41:09.883532 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-e2d3ebb7-4931-4ad0-ba46-47ceb116b757 req-44c0031e-bd60-4f2a-93df-1bd1a46539cb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036088 May 26 19:41:09.884767 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 242/474] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:41:09.929485 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:09.930097 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:09.936327 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:09.936781 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:09.937545 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:09.937982 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:10.204245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:10.213063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:10.215526 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:10.217110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-516ace0b-bee9-4935-a386-9be948acdfac tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.291541 May 26 19:41:10.217999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 233/475] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:09 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:10.579287 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-059071d6-ef7b-45a8-bf9b-d2638d1fcdcd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:10.580033 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-059071d6-ef7b-45a8-bf9b-d2638d1fcdcd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:10.586165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-059071d6-ef7b-45a8-bf9b-d2638d1fcdcd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:10.586607 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-059071d6-ef7b-45a8-bf9b-d2638d1fcdcd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:10.587411 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-059071d6-ef7b-45a8-bf9b-d2638d1fcdcd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:10.587839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-059071d6-ef7b-45a8-bf9b-d2638d1fcdcd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:10.751291 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-059071d6-ef7b-45a8-bf9b-d2638d1fcdcd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:10.759460 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-059071d6-ef7b-45a8-bf9b-d2638d1fcdcd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1366 microversion: 2.1 time: 0.184358 May 26 19:41:10.760460 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 243/476] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:10 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:10.862826 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-7bc1d1e9-7e72-4e9e-9a6d-3ec2cc76a7fc req-25577266-f4e3-4e4c-abe3-3de15f7bf913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915b2746-efa1-4bc1-897f-dd3382e94a03", "name": "network-vif-plugged", "status": "completed", "tag": "d5745298-9304-403b-b990-9deaf1756306"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:10.873661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-7bc1d1e9-7e72-4e9e-9a6d-3ec2cc76a7fc req-25577266-f4e3-4e4c-abe3-3de15f7bf913 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:10.874184 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-7bc1d1e9-7e72-4e9e-9a6d-3ec2cc76a7fc req-25577266-f4e3-4e4c-abe3-3de15f7bf913 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:10.886354 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-7bc1d1e9-7e72-4e9e-9a6d-3ec2cc76a7fc req-25577266-f4e3-4e4c-abe3-3de15f7bf913 service nova] Creating event network-vif-plugged:d5745298-9304-403b-b990-9deaf1756306 for instance 915b2746-efa1-4bc1-897f-dd3382e94a03 on hv-cinder-82549 May 26 19:41:10.894148 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-7bc1d1e9-7e72-4e9e-9a6d-3ec2cc76a7fc req-25577266-f4e3-4e4c-abe3-3de15f7bf913 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 May 26 19:41:10.894148 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 234/477] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:41:11.235959 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:11.236622 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:11.239073 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:11.244208 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:11.244659 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:11.245466 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:11.245904 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:11.388734 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:11.397642 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:11.399165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:11.400317 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f5d66ae0-5aa5-4ed9-9aa5-46471bd8cbdd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.168322 May 26 19:41:11.400872 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 244/478] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:11 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:11.778225 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-478903f3-6558-431b-8c5c-96d4b880076e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:11.778949 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-478903f3-6558-431b-8c5c-96d4b880076e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:11.785158 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-478903f3-6558-431b-8c5c-96d4b880076e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:11.785603 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-478903f3-6558-431b-8c5c-96d4b880076e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:11.786355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-478903f3-6558-431b-8c5c-96d4b880076e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:11.786789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-478903f3-6558-431b-8c5c-96d4b880076e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:11.907697 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-76aac3cd-0c06-4df7-a631-9ed62280ce54 req-0cbf374c-eafc-4d14-8dc1-fc4c48edce28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aefdfc4-c74d-48dd-8945-bdd21a5c0566", "tag": "13d90f7c-15e0-429a-a8cd-b7ec2c9a22a1"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:11.916265 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-76aac3cd-0c06-4df7-a631-9ed62280ce54 req-0cbf374c-eafc-4d14-8dc1-fc4c48edce28 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:11.916710 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-76aac3cd-0c06-4df7-a631-9ed62280ce54 req-0cbf374c-eafc-4d14-8dc1-fc4c48edce28 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:11.927540 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-478903f3-6558-431b-8c5c-96d4b880076e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:11.927540 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:11.928237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-76aac3cd-0c06-4df7-a631-9ed62280ce54 req-0cbf374c-eafc-4d14-8dc1-fc4c48edce28 service nova] Creating event network-changed:13d90f7c-15e0-429a-a8cd-b7ec2c9a22a1 for instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 on hv-cinder-82549 May 26 19:41:11.930566 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-478903f3-6558-431b-8c5c-96d4b880076e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1366 microversion: 2.1 time: 0.156710 May 26 19:41:11.931398 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 235/479] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:11 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:11.933715 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-76aac3cd-0c06-4df7-a631-9ed62280ce54 req-0cbf374c-eafc-4d14-8dc1-fc4c48edce28 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028992 May 26 19:41:11.934370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 245/480] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:41:12.418382 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:12.419027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:12.425800 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:12.426262 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:12.427052 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:12.427491 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:12.648034 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:12.656276 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:12.657759 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:12.658915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-652c8a4c-d0ef-4764-980b-3952d225ad54 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.245008 May 26 19:41:12.659480 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 236/481] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:12 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:12.948444 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-32999757-ae3f-4730-9b43-045b400c1825 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:12.949140 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-32999757-ae3f-4730-9b43-045b400c1825 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:12.955479 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-32999757-ae3f-4730-9b43-045b400c1825 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:12.955926 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-32999757-ae3f-4730-9b43-045b400c1825 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:12.956688 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-32999757-ae3f-4730-9b43-045b400c1825 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:12.957238 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-32999757-ae3f-4730-9b43-045b400c1825 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:13.086364 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-32999757-ae3f-4730-9b43-045b400c1825 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:13.094411 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-32999757-ae3f-4730-9b43-045b400c1825 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1366 microversion: 2.1 time: 0.151123 May 26 19:41:13.095011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 246/482] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:12 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:13.676882 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:13.677392 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:13.684486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:13.684934 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:13.685686 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:13.686119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:13.819421 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:13.828788 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:13.830285 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:13.831526 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f201815f-1b5f-4f43-a256-049fc673fc61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.158634 May 26 19:41:13.832194 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 237/483] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:13 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:14.111498 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c5016f5e-feca-4abd-b38a-aade09f3ab0b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:14.112100 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c5016f5e-feca-4abd-b38a-aade09f3ab0b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:14.118894 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c5016f5e-feca-4abd-b38a-aade09f3ab0b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:14.119361 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c5016f5e-feca-4abd-b38a-aade09f3ab0b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:14.120743 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c5016f5e-feca-4abd-b38a-aade09f3ab0b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:14.121177 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c5016f5e-feca-4abd-b38a-aade09f3ab0b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:14.253768 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c5016f5e-feca-4abd-b38a-aade09f3ab0b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:14.261478 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c5016f5e-feca-4abd-b38a-aade09f3ab0b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1366 microversion: 2.1 time: 0.153656 May 26 19:41:14.261964 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 247/484] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:14 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:14.849229 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:14.849863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:14.856600 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:14.857043 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:14.857828 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:14.858260 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:14.993413 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:15.002658 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:15.004183 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:15.005321 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4881b3b5-a649-497b-93f3-4446ad695014 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1809 microversion: 2.20 time: 0.160174 May 26 19:41:15.006194 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 238/485] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:14 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:15.277517 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-cc20a24d-fb56-4321-88d7-4eb2f2643f1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:15.278124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-cc20a24d-fb56-4321-88d7-4eb2f2643f1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:15.284736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cc20a24d-fb56-4321-88d7-4eb2f2643f1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:15.285181 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cc20a24d-fb56-4321-88d7-4eb2f2643f1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:15.285943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cc20a24d-fb56-4321-88d7-4eb2f2643f1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:15.286415 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cc20a24d-fb56-4321-88d7-4eb2f2643f1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:15.435215 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cc20a24d-fb56-4321-88d7-4eb2f2643f1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:15.445708 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-cc20a24d-fb56-4321-88d7-4eb2f2643f1c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1366 microversion: 2.1 time: 0.172062 May 26 19:41:15.446275 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 248/486] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:15 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:16.024335 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:16.024943 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:16.027772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:16.028531 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=10 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:16.033810 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:16.034300 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:16.035128 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:16.035569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:16.164383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:16.172689 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:16.174193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:16.175372 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9dbe7e46-2a87-4749-abb9-2c48fe52e62c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1796 microversion: 2.20 time: 0.154992 May 26 19:41:16.175932 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 239/487] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:16 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1796 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:16.463800 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d34c0190-7274-4afc-a0c6-4b65c02c350c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:16.464980 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d34c0190-7274-4afc-a0c6-4b65c02c350c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:16.466994 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:16.472270 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d34c0190-7274-4afc-a0c6-4b65c02c350c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:16.472715 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d34c0190-7274-4afc-a0c6-4b65c02c350c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:16.473476 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d34c0190-7274-4afc-a0c6-4b65c02c350c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:16.473905 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d34c0190-7274-4afc-a0c6-4b65c02c350c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:16.599072 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d34c0190-7274-4afc-a0c6-4b65c02c350c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:16.606418 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d34c0190-7274-4afc-a0c6-4b65c02c350c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1366 microversion: 2.1 time: 0.146422 May 26 19:41:16.607001 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 249/488] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:16 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:16.919349 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-08a21464-03eb-4e25-9e0b-e2f8cadbdfe9 req-be0ede1f-eeb1-4e7f-a139-989943747637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aefdfc4-c74d-48dd-8945-bdd21a5c0566", "name": "network-vif-plugged", "status": "completed", "tag": "13d90f7c-15e0-429a-a8cd-b7ec2c9a22a1"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:16.927396 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-08a21464-03eb-4e25-9e0b-e2f8cadbdfe9 req-be0ede1f-eeb1-4e7f-a139-989943747637 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:16.927798 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-08a21464-03eb-4e25-9e0b-e2f8cadbdfe9 req-be0ede1f-eeb1-4e7f-a139-989943747637 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:16.939255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-08a21464-03eb-4e25-9e0b-e2f8cadbdfe9 req-be0ede1f-eeb1-4e7f-a139-989943747637 service nova] Creating event network-vif-plugged:13d90f7c-15e0-429a-a8cd-b7ec2c9a22a1 for instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 on hv-cinder-82549 May 26 19:41:16.943941 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-08a21464-03eb-4e25-9e0b-e2f8cadbdfe9 req-be0ede1f-eeb1-4e7f-a139-989943747637 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028852 May 26 19:41:16.944517 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 240/489] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:41:17.623202 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e8c21e98-b89d-4089-940b-e9509258b7f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:17.623740 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e8c21e98-b89d-4089-940b-e9509258b7f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:17.630168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e8c21e98-b89d-4089-940b-e9509258b7f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:17.630620 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e8c21e98-b89d-4089-940b-e9509258b7f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:17.631403 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e8c21e98-b89d-4089-940b-e9509258b7f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:17.631839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e8c21e98-b89d-4089-940b-e9509258b7f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:17.758457 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e8c21e98-b89d-4089-940b-e9509258b7f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:17.766286 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e8c21e98-b89d-4089-940b-e9509258b7f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1366 microversion: 2.1 time: 0.147073 May 26 19:41:17.766842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 250/490] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:17 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:18.784566 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8a844b85-268a-40d7-a745-f7aec9842c20 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:18.785254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8a844b85-268a-40d7-a745-f7aec9842c20 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:18.791851 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8a844b85-268a-40d7-a745-f7aec9842c20 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:18.792299 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8a844b85-268a-40d7-a745-f7aec9842c20 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:18.793697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8a844b85-268a-40d7-a745-f7aec9842c20 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:18.794190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8a844b85-268a-40d7-a745-f7aec9842c20 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:18.928340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8a844b85-268a-40d7-a745-f7aec9842c20 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:18.935810 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8a844b85-268a-40d7-a745-f7aec9842c20 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1366 microversion: 2.1 time: 0.156046 May 26 19:41:18.937677 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 241/491] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:18 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:19.952797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-776a3980-b507-4645-b0b2-15b53884eeed tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:19.953400 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-776a3980-b507-4645-b0b2-15b53884eeed tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:19.960096 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-776a3980-b507-4645-b0b2-15b53884eeed tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:19.965078 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-776a3980-b507-4645-b0b2-15b53884eeed tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:19.965078 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-776a3980-b507-4645-b0b2-15b53884eeed tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:19.965078 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-776a3980-b507-4645-b0b2-15b53884eeed tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:20.089745 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-776a3980-b507-4645-b0b2-15b53884eeed tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:20.097137 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-776a3980-b507-4645-b0b2-15b53884eeed tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1557 microversion: 2.1 time: 0.148236 May 26 19:41:20.097699 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 251/492] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:19 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:20.113562 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-91de5153-7601-4bb8-8e74-e6b939847937 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:20.114063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-91de5153-7601-4bb8-8e74-e6b939847937 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:20.120750 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-91de5153-7601-4bb8-8e74-e6b939847937 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:20.121743 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-91de5153-7601-4bb8-8e74-e6b939847937 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:20.122501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-91de5153-7601-4bb8-8e74-e6b939847937 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:20.122965 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-91de5153-7601-4bb8-8e74-e6b939847937 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:20.196590 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-91de5153-7601-4bb8-8e74-e6b939847937 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086830 May 26 19:41:20.197181 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 242/493] 10.222.0.72 () {58 vars in 1274 bytes} [Thu May 26 19:41:20 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:41:21.172402 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-3c4ce45a-d98c-4802-be87-8cdeedb931ec req-f8ac5869-10c1-4537-9afc-c3da8543d61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aefdfc4-c74d-48dd-8945-bdd21a5c0566", "tag": "13d90f7c-15e0-429a-a8cd-b7ec2c9a22a1"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:21.180938 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-3c4ce45a-d98c-4802-be87-8cdeedb931ec req-f8ac5869-10c1-4537-9afc-c3da8543d61e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:21.181370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-3c4ce45a-d98c-4802-be87-8cdeedb931ec req-f8ac5869-10c1-4537-9afc-c3da8543d61e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:21.194799 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-3c4ce45a-d98c-4802-be87-8cdeedb931ec req-f8ac5869-10c1-4537-9afc-c3da8543d61e service nova] Creating event network-changed:13d90f7c-15e0-429a-a8cd-b7ec2c9a22a1 for instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 on hv-cinder-82549 May 26 19:41:21.200406 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-3c4ce45a-d98c-4802-be87-8cdeedb931ec req-f8ac5869-10c1-4537-9afc-c3da8543d61e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032351 May 26 19:41:21.200980 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 252/494] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:41:45.935495 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:45.936607 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=37 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:45.942797 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-49336cfa-5f13-4e7b-af1d-d8fe18d37cf5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:45.943312 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-49336cfa-5f13-4e7b-af1d-d8fe18d37cf5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:45.951745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-49336cfa-5f13-4e7b-af1d-d8fe18d37cf5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:45.952194 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-49336cfa-5f13-4e7b-af1d-d8fe18d37cf5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:45.952991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-49336cfa-5f13-4e7b-af1d-d8fe18d37cf5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:45.953429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-49336cfa-5f13-4e7b-af1d-d8fe18d37cf5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:46.078043 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-49336cfa-5f13-4e7b-af1d-d8fe18d37cf5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lazy-loading 'services' on Instance uuid d19b79e3-ce41-4806-b97f-8a14cd797d63 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:41:46.335877 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-49336cfa-5f13-4e7b-af1d-d8fe18d37cf5 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments/451e1528-abeb-47f3-98f4-db063b508056" status: 202 len: 0 microversion: 2.1 time: 0.402535 May 26 19:41:46.336622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 243/495] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:41:45 2022] DELETE /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments/451e1528-abeb-47f3-98f4-db063b508056 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:41:46.342870 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=17 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:46.343708 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=56 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:46.348498 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e4da21c6-5dc3-4c0a-8af1-4ccc4a9ac7ca tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:46.349509 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e4da21c6-5dc3-4c0a-8af1-4ccc4a9ac7ca tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:46.355709 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4da21c6-5dc3-4c0a-8af1-4ccc4a9ac7ca tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:46.356239 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4da21c6-5dc3-4c0a-8af1-4ccc4a9ac7ca tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:46.357029 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4da21c6-5dc3-4c0a-8af1-4ccc4a9ac7ca tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:46.357483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4da21c6-5dc3-4c0a-8af1-4ccc4a9ac7ca tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:46.389244 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e4da21c6-5dc3-4c0a-8af1-4ccc4a9ac7ca tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047935 May 26 19:41:46.389850 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 253/496] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:41:46 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:41:47.402180 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8e2729cb-7e1d-49bc-9055-2c24759ec80e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:47.403222 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8e2729cb-7e1d-49bc-9055-2c24759ec80e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:47.409777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8e2729cb-7e1d-49bc-9055-2c24759ec80e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:47.410234 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8e2729cb-7e1d-49bc-9055-2c24759ec80e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:47.411039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8e2729cb-7e1d-49bc-9055-2c24759ec80e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:47.411489 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8e2729cb-7e1d-49bc-9055-2c24759ec80e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:47.441555 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8e2729cb-7e1d-49bc-9055-2c24759ec80e tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 May 26 19:41:47.442111 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 244/497] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:41:47 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:41:48.453804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-75c52365-a42f-4274-8c4c-63e852272ed7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:48.454761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-75c52365-a42f-4274-8c4c-63e852272ed7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:48.461427 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75c52365-a42f-4274-8c4c-63e852272ed7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:48.461864 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75c52365-a42f-4274-8c4c-63e852272ed7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:48.462609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75c52365-a42f-4274-8c4c-63e852272ed7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:48.463073 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75c52365-a42f-4274-8c4c-63e852272ed7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:48.490303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-75c52365-a42f-4274-8c4c-63e852272ed7 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041041 May 26 19:41:48.491136 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 254/498] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:41:48 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 19:41:48.568688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bdfff9bb-dc77-4c44-b757-e7b86f9c9c71 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:48.569209 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bdfff9bb-dc77-4c44-b757-e7b86f9c9c71 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:48.575642 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bdfff9bb-dc77-4c44-b757-e7b86f9c9c71 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:48.576098 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bdfff9bb-dc77-4c44-b757-e7b86f9c9c71 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:48.576833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bdfff9bb-dc77-4c44-b757-e7b86f9c9c71 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:48.577264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bdfff9bb-dc77-4c44-b757-e7b86f9c9c71 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:48.602037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bdfff9bb-dc77-4c44-b757-e7b86f9c9c71 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:41:48.853921 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bdfff9bb-dc77-4c44-b757-e7b86f9c9c71 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 204 len: 0 microversion: 2.1 time: 0.289445 May 26 19:41:48.854510 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 245/499] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:41:48 2022] DELETE /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:41:48.863065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8f105dbc-2a36-4bc1-b8a6-3acb0af1b8b1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:48.863702 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8f105dbc-2a36-4bc1-b8a6-3acb0af1b8b1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:48.869910 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8f105dbc-2a36-4bc1-b8a6-3acb0af1b8b1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:48.870354 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8f105dbc-2a36-4bc1-b8a6-3acb0af1b8b1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:48.871149 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8f105dbc-2a36-4bc1-b8a6-3acb0af1b8b1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:48.871587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8f105dbc-2a36-4bc1-b8a6-3acb0af1b8b1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:48.998139 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8f105dbc-2a36-4bc1-b8a6-3acb0af1b8b1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:49.005633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8f105dbc-2a36-4bc1-b8a6-3acb0af1b8b1 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1690 microversion: 2.1 time: 0.147032 May 26 19:41:49.006193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 255/500] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:48 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:49.727885 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2af2d894-6974-4d39-995a-945394424dc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:49.728455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2af2d894-6974-4d39-995a-945394424dc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:49.734976 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2af2d894-6974-4d39-995a-945394424dc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:49.735429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2af2d894-6974-4d39-995a-945394424dc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:49.736686 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2af2d894-6974-4d39-995a-945394424dc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:49.737120 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2af2d894-6974-4d39-995a-945394424dc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:49.766173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2af2d894-6974-4d39-995a-945394424dc0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments/c69f75c7-05d9-47b7-b286-a82a9e8f7a70" status: 200 len: 194 microversion: 2.20 time: 0.042604 May 26 19:41:49.766675 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 246/501] 10.222.0.72 () {60 vars in 1453 bytes} [Thu May 26 19:41:49 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments/c69f75c7-05d9-47b7-b286-a82a9e8f7a70 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:41:49.828295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4aa38d3c-708a-4403-8dd2-8ddde088c7db tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:49.828817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4aa38d3c-708a-4403-8dd2-8ddde088c7db tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:49.835749 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4aa38d3c-708a-4403-8dd2-8ddde088c7db tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:49.836192 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4aa38d3c-708a-4403-8dd2-8ddde088c7db tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:49.836942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4aa38d3c-708a-4403-8dd2-8ddde088c7db tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:49.837369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4aa38d3c-708a-4403-8dd2-8ddde088c7db tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:49.915955 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-4aa38d3c-708a-4403-8dd2-8ddde088c7db tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lazy-loading 'services' on Instance uuid 915b2746-efa1-4bc1-897f-dd3382e94a03 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:41:50.023162 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-00bc1514-c19f-410d-8914-f99244492f10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:50.023771 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-00bc1514-c19f-410d-8914-f99244492f10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:50.029798 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00bc1514-c19f-410d-8914-f99244492f10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:50.030249 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00bc1514-c19f-410d-8914-f99244492f10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:50.031037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00bc1514-c19f-410d-8914-f99244492f10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:50.031481 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00bc1514-c19f-410d-8914-f99244492f10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:50.123753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4aa38d3c-708a-4403-8dd2-8ddde088c7db tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "DELETE /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments/c69f75c7-05d9-47b7-b286-a82a9e8f7a70" status: 202 len: 0 microversion: 2.20 time: 0.299190 May 26 19:41:50.124457 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 256/502] 10.222.0.72 () {60 vars in 1456 bytes} [Thu May 26 19:41:49 2022] DELETE /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments/c69f75c7-05d9-47b7-b286-a82a9e8f7a70 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 19:41:50.133593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4623286a-ff43-4354-b851-17a1b84162c7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:50.134674 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4623286a-ff43-4354-b851-17a1b84162c7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:50.140933 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4623286a-ff43-4354-b851-17a1b84162c7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:50.141421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4623286a-ff43-4354-b851-17a1b84162c7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:50.142248 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4623286a-ff43-4354-b851-17a1b84162c7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:50.143213 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4623286a-ff43-4354-b851-17a1b84162c7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:50.163721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-00bc1514-c19f-410d-8914-f99244492f10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:50.171449 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-00bc1514-c19f-410d-8914-f99244492f10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1690 microversion: 2.1 time: 0.152246 May 26 19:41:50.171815 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4623286a-ff43-4354-b851-17a1b84162c7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042411 May 26 19:41:50.172179 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 247/503] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:50 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:41:50.172361 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 257/504] 10.222.0.72 () {60 vars in 1342 bytes} [Thu May 26 19:41:50 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 19:41:51.183357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5aeb1fbd-224b-49f0-a924-763a6f2ba0d4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:51.184277 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5aeb1fbd-224b-49f0-a924-763a6f2ba0d4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:51.188433 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7cf91191-d5b0-4468-b4c0-af07e8964901 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:51.189080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7cf91191-d5b0-4468-b4c0-af07e8964901 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:51.191494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5aeb1fbd-224b-49f0-a924-763a6f2ba0d4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:51.191938 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5aeb1fbd-224b-49f0-a924-763a6f2ba0d4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:51.192699 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5aeb1fbd-224b-49f0-a924-763a6f2ba0d4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:51.193136 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5aeb1fbd-224b-49f0-a924-763a6f2ba0d4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:51.195943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7cf91191-d5b0-4468-b4c0-af07e8964901 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:51.196383 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7cf91191-d5b0-4468-b4c0-af07e8964901 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:51.197144 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7cf91191-d5b0-4468-b4c0-af07e8964901 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:51.197571 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7cf91191-d5b0-4468-b4c0-af07e8964901 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:51.221850 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5aeb1fbd-224b-49f0-a924-763a6f2ba0d4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042435 May 26 19:41:51.222410 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 248/505] 10.222.0.72 () {60 vars in 1342 bytes} [Thu May 26 19:41:51 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:41:51.330487 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7cf91191-d5b0-4468-b4c0-af07e8964901 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:51.339032 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7cf91191-d5b0-4468-b4c0-af07e8964901 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1690 microversion: 2.1 time: 0.154438 May 26 19:41:51.339599 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 258/506] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:51 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:41:52.232882 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ef8ee93b-c680-47e6-a144-520dee952163 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:52.233793 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ef8ee93b-c680-47e6-a144-520dee952163 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:52.240325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef8ee93b-c680-47e6-a144-520dee952163 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:52.240770 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef8ee93b-c680-47e6-a144-520dee952163 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:52.241523 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef8ee93b-c680-47e6-a144-520dee952163 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:52.242211 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef8ee93b-c680-47e6-a144-520dee952163 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:52.277920 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ef8ee93b-c680-47e6-a144-520dee952163 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048997 May 26 19:41:52.278474 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 249/507] 10.222.0.72 () {60 vars in 1342 bytes} [Thu May 26 19:41:52 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:41:52.356277 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-19ab30eb-0a82-4220-b55b-01cc2f4550d3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:52.356894 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-19ab30eb-0a82-4220-b55b-01cc2f4550d3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:52.364026 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-19ab30eb-0a82-4220-b55b-01cc2f4550d3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:52.364468 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-19ab30eb-0a82-4220-b55b-01cc2f4550d3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:52.365219 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-19ab30eb-0a82-4220-b55b-01cc2f4550d3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:52.365645 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-19ab30eb-0a82-4220-b55b-01cc2f4550d3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:52.493010 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-19ab30eb-0a82-4220-b55b-01cc2f4550d3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:52.502547 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-19ab30eb-0a82-4220-b55b-01cc2f4550d3 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1690 microversion: 2.1 time: 0.150312 May 26 19:41:52.503173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 259/508] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:52 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:53.289621 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b81df974-e93d-4003-b190-77db476bfe58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:53.290553 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b81df974-e93d-4003-b190-77db476bfe58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:53.296806 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b81df974-e93d-4003-b190-77db476bfe58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:53.303120 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b81df974-e93d-4003-b190-77db476bfe58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:53.303120 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b81df974-e93d-4003-b190-77db476bfe58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:53.303120 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b81df974-e93d-4003-b190-77db476bfe58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:53.328102 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b81df974-e93d-4003-b190-77db476bfe58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042435 May 26 19:41:53.331537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 250/509] 10.222.0.72 () {60 vars in 1342 bytes} [Thu May 26 19:41:53 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:41:53.520834 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b337831c-84a0-4e7a-b880-2c8751aea263 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:53.521372 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b337831c-84a0-4e7a-b880-2c8751aea263 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:53.528452 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b337831c-84a0-4e7a-b880-2c8751aea263 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:53.528893 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b337831c-84a0-4e7a-b880-2c8751aea263 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:53.529657 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b337831c-84a0-4e7a-b880-2c8751aea263 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:53.530083 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b337831c-84a0-4e7a-b880-2c8751aea263 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:53.676962 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b337831c-84a0-4e7a-b880-2c8751aea263 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:53.684983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b337831c-84a0-4e7a-b880-2c8751aea263 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1690 microversion: 2.1 time: 0.168836 May 26 19:41:53.685928 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 260/510] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:53 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:53.961292 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-7d0e6162-f719-4365-a92b-54a3c21afbaa req-e7948c7a-ff4e-4c32-bf95-f1a9004e6ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19b79e3-ce41-4806-b97f-8a14cd797d63", "name": "network-vif-deleted", "tag": "e6b42048-c3ab-4c39-bdb2-eab21f5b42e7"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:53.969275 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-7d0e6162-f719-4365-a92b-54a3c21afbaa req-e7948c7a-ff4e-4c32-bf95-f1a9004e6ef1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:53.969720 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-7d0e6162-f719-4365-a92b-54a3c21afbaa req-e7948c7a-ff4e-4c32-bf95-f1a9004e6ef1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:53.980791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-7d0e6162-f719-4365-a92b-54a3c21afbaa req-e7948c7a-ff4e-4c32-bf95-f1a9004e6ef1 service nova] Creating event network-vif-deleted:e6b42048-c3ab-4c39-bdb2-eab21f5b42e7 for instance d19b79e3-ce41-4806-b97f-8a14cd797d63 on hv-cinder-82549 May 26 19:41:53.985556 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-7d0e6162-f719-4365-a92b-54a3c21afbaa req-e7948c7a-ff4e-4c32-bf95-f1a9004e6ef1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027960 May 26 19:41:53.986169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 251/511] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:41:54.341939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9abc1fe2-f37f-4c01-8b89-200ecba43ca8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:54.342820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9abc1fe2-f37f-4c01-8b89-200ecba43ca8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:54.349041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9abc1fe2-f37f-4c01-8b89-200ecba43ca8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:54.349487 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9abc1fe2-f37f-4c01-8b89-200ecba43ca8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:54.350257 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9abc1fe2-f37f-4c01-8b89-200ecba43ca8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:54.350691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9abc1fe2-f37f-4c01-8b89-200ecba43ca8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:54.383622 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9abc1fe2-f37f-4c01-8b89-200ecba43ca8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046925 May 26 19:41:54.384185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 261/512] 10.222.0.72 () {60 vars in 1342 bytes} [Thu May 26 19:41:54 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:54.448384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-34f71d23-829c-4bed-b5c4-47657396d173 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:54.448971 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-34f71d23-829c-4bed-b5c4-47657396d173 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:54.455183 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34f71d23-829c-4bed-b5c4-47657396d173 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:54.455988 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34f71d23-829c-4bed-b5c4-47657396d173 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:54.456394 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34f71d23-829c-4bed-b5c4-47657396d173 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:54.456832 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34f71d23-829c-4bed-b5c4-47657396d173 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:54.481050 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-34f71d23-829c-4bed-b5c4-47657396d173 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:41:54.701545 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:54.707408 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:54.709125 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:54.709577 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:54.710340 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:54.710775 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:54.743651 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:54.744111 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:54.744564 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lazy-loading 'fault' on Instance uuid d19b79e3-ce41-4806-b97f-8a14cd797d63 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:41:54.748361 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-34f71d23-829c-4bed-b5c4-47657396d173 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "DELETE /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 204 len: 0 microversion: 2.20 time: 0.304334 May 26 19:41:54.753189 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 252/513] 10.222.0.72 () {60 vars in 1279 bytes} [Thu May 26 19:41:54 2022] DELETE /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 19:41:54.758039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:54.758804 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:54.765634 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:54.766080 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:54.766839 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:54.767356 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:54.787150 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:54.797074 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7bbd898e-7137-4b2d-ac42-11637ff78e39 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1336 microversion: 2.1 time: 0.099221 May 26 19:41:54.797723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 262/514] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:54 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:41:55.067902 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:55.075833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:55.079174 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:55.079174 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3f6ac420-8eec-4556-88ce-c1e51b9038c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.324671 May 26 19:41:55.079174 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 253/515] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:54 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:41:55.815588 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:55.816124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:55.822542 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:55.829446 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:55.829446 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:55.829446 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:55.854261 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:55.854706 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:55.855300 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lazy-loading 'fault' on Instance uuid d19b79e3-ce41-4806-b97f-8a14cd797d63 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:41:55.950873 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:55.958323 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-60554724-d699-405a-938d-d7c6493a6254 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 200 len: 1336 microversion: 2.1 time: 0.147410 May 26 19:41:55.958893 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 263/516] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:55 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 1336 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:41:56.097748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:56.098273 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:56.104984 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:56.105430 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:56.106211 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:56.106644 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:56.234441 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:56.243199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:56.244781 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:56.245924 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a0f0698d-2949-4801-86e6-0d0e5537a9fd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.152630 May 26 19:41:56.246538 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 254/517] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:56 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:56.975832 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:56.976446 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: d19b79e3-ce41-4806-b97f-8a14cd797d63] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:56.983903 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:56.984641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:56.985996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:56.986605 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:57.002683 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] HTTP exception thrown: Instance d19b79e3-ce41-4806-b97f-8a14cd797d63 could not be found. May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Request method failure captured: May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 HTTP/1.1 May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bk-wWCrmDu3OZPPjGfGavhx6ia2Eyb0y9MeDKXOg5P9P_grBQpBxNjv2BirTX3fBsSVTAVkwePvf99LDpsNyrGPxHS5r2J07Cyp_VAt50gwM4c42wDr0Kb3F0ETLaB9On5ikFz8URDxONdpFnJS2OXZ7NgZiRJLg7Vui1vzIRTa2E May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:41:57.004376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bf99d88fec9046608e464a5e2c75506e", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 9a0e96324450438699abfcefec6d1a6d May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance d19b79e3-ce41-4806-b97f-8a14cd797d63 could not be found. May 26 19:41:57.005999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': 'd19b79e3-ce41-4806-b97f-8a14cd797d63'} May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19b79e3-ce41-4806-b97f-8a14cd797d63 could not be found. May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:41:57.006787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19b79e3-ce41-4806-b97f-8a14cd797d63 could not be found. May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19b79e3-ce41-4806-b97f-8a14cd797d63 could not be found. May 26 19:41:57.008299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:57.010620 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Returning 404 to user: Instance d19b79e3-ce41-4806-b97f-8a14cd797d63 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:41:57.011674 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0aa91577-5341-4f42-b263-02fe664f543b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63" status: 404 len: 111 microversion: 2.1 time: 0.040572 May 26 19:41:57.015804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 264/518] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:41:56 2022] GET /compute/v2.1/servers/d19b79e3-ce41-4806-b97f-8a14cd797d63 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:41:57.021573 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d6be1c9e-6433-4adc-801e-9d1258f68d10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '.version_select at 0x7fa7882429d0>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:57.108133 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d6be1c9e-6433-4adc-801e-9d1258f68d10 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981778791" status: 202 len: 0 microversion: 2.1 time: 0.091041 May 26 19:41:57.109163 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 255/519] 10.222.0.72 () {58 vars in 1220 bytes} [Thu May 26 19:41:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981778791 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:41:57.264818 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:57.265647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:57.273990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:57.275107 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:57.275992 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:57.276398 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:57.392095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ce1cf3b2-d22d-4499-be1b-00f99709297b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:57.392835 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ce1cf3b2-d22d-4499-be1b-00f99709297b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:57.400455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ce1cf3b2-d22d-4499-be1b-00f99709297b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:57.401180 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ce1cf3b2-d22d-4499-be1b-00f99709297b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:57.402755 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ce1cf3b2-d22d-4499-be1b-00f99709297b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:57.403552 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ce1cf3b2-d22d-4499-be1b-00f99709297b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:57.432351 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ce1cf3b2-d22d-4499-be1b-00f99709297b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/ips" status: 200 len: 150 microversion: 2.1 time: 0.044177 May 26 19:41:57.433233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 256/520] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:41:57 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:41:57.433628 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:57.442858 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:57.444421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:57.445575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b2b1a862-69c3-4ce9-b1d6-787d9f5798f7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1724 microversion: 2.20 time: 0.185054 May 26 19:41:57.446320 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 265/521] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:57 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:57.994653 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-a9ff3738-54fe-4066-884d-be2f0c5db33e req-2174092a-b3a7-4545-aa06-1f6c6ed00613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915b2746-efa1-4bc1-897f-dd3382e94a03", "name": "network-vif-deleted", "tag": "d5745298-9304-403b-b990-9deaf1756306"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:58.004165 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-a9ff3738-54fe-4066-884d-be2f0c5db33e req-2174092a-b3a7-4545-aa06-1f6c6ed00613 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:58.004866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-a9ff3738-54fe-4066-884d-be2f0c5db33e req-2174092a-b3a7-4545-aa06-1f6c6ed00613 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:58.024109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-a9ff3738-54fe-4066-884d-be2f0c5db33e req-2174092a-b3a7-4545-aa06-1f6c6ed00613 service nova] Creating event network-vif-deleted:d5745298-9304-403b-b990-9deaf1756306 for instance 915b2746-efa1-4bc1-897f-dd3382e94a03 on hv-cinder-82549 May 26 19:41:58.030673 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-a9ff3738-54fe-4066-884d-be2f0c5db33e req-2174092a-b3a7-4545-aa06-1f6c6ed00613 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040023 May 26 19:41:58.034953 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 257/522] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:41:58.464335 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:58.465000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:58.472705 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:58.473151 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:58.473982 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:58.474419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:58.507617 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:58.508057 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:58.508503 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lazy-loading 'fault' on Instance uuid 915b2746-efa1-4bc1-897f-dd3382e94a03 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:41:58.555393 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:58.563499 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:58.565274 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:41:58.566436 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-cb956d53-1b18-426c-a8ad-900a82921923 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 200 len: 1370 microversion: 2.20 time: 0.106224 May 26 19:41:58.567203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 266/523] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:58 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 1370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:41:59.044260 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c8a1b455-87f4-4d44-a8fb-d3a4dd667002 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:41:59.045390 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c8a1b455-87f4-4d44-a8fb-d3a4dd667002 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:59.052162 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c8a1b455-87f4-4d44-a8fb-d3a4dd667002 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:59.052615 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c8a1b455-87f4-4d44-a8fb-d3a4dd667002 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:59.053371 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c8a1b455-87f4-4d44-a8fb-d3a4dd667002 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:59.053808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c8a1b455-87f4-4d44-a8fb-d3a4dd667002 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:59.057465 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:59.585456 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:59.586018 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:41:59.592575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:59.593028 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:59.593794 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:41:59.594231 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:41:59.607403 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] HTTP exception thrown: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Request method failure captured: May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 HTTP/1.1 May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9cvDxXfX5L2zD_VUvGVpwou4YkS7djzOnTmsiFcpoj4tojRi4CvjbSylhvw8nwtiTTiBOH43cISDHd_Fy9qAYo6PkaoznXuDJfrUiNp_jmeEcisuhQwDQkydRS3eKVeZXUxtWag-dDTAir5etCW5Gqj1gkVibjMzejUtg_BIUcF_8w May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Openstack-Nova-Api-Version: 2.20 May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: b189404964f64aa88af37e536c1c7464 May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:41:59.609222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b189404964f64aa88af37e536c1c7464", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b189404964f64aa88af37e536c1c7464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: b189404964f64aa88af37e536c1c7464 May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: a1327d80a17743daa137acaad895cd51 May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:41:59.611497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '915b2746-efa1-4bc1-897f-dd3382e94a03'} May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:41:59.612587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:41:59.613971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:41:59.615242 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Returning 404 to user: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:41:59.615242 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c07d191d-7e98-4b40-b7cc-5b1b19c05044 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 404 len: 111 microversion: 2.20 time: 0.030259 May 26 19:41:59.615242 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 267/524] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:41:59 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 19:41:59.620280 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d46e04bb-066f-42c1-bcf5-0f3a28d5622b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '.version_select at 0x7fa78835af70>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:41:59.714823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d46e04bb-066f-42c1-bcf5-0f3a28d5622b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807550166" status: 204 len: 0 microversion: 2.20 time: 0.098296 May 26 19:41:59.715617 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 268/525] 10.222.0.72 () {60 vars in 1258 bytes} [Thu May 26 19:41:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807550166 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 19:41:59.812276 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c8a1b455-87f4-4d44-a8fb-d3a4dd667002 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.772664 May 26 19:41:59.813195 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 258/526] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:41:59 2022] POST /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:00.461428 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-03f25ce1-eb21-4fa9-988b-54289b839a7c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'create', calling method: .version_select at 0x7fa788211820>, body: {"keypair": {"name": "tempest-keypair-607719719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClavE+quc6IwW2on9ieUlzkd98k9jTeWnHwmf3/MrgnWU3IA6+8NXpFS6SnNX/dgJruvNm7mpWYQdQMqzGSI9qt+WDk3owkTA2fON8AM5iU9IOU0+ou7io9HI5WCP19fA=="}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:00.478764 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-03f25ce1-eb21-4fa9-988b-54289b839a7c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Getting quotas for project b189404964f64aa88af37e536c1c7464. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:42:00.482809 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-03f25ce1-eb21-4fa9-988b-54289b839a7c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Getting quotas for user a1327d80a17743daa137acaad895cd51 and project b189404964f64aa88af37e536c1c7464. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:42:00.572221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-03f25ce1-eb21-4fa9-988b-54289b839a7c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.114742 May 26 19:42:00.572970 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 269/527] 10.222.0.72 () {62 vars in 1199 bytes} [Thu May 26 19:42:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 19:42:00.792837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c3d7b6bb-7d89-4cc7-a29d-ae107a4821dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:00.793462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c3d7b6bb-7d89-4cc7-a29d-ae107a4821dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:00.799912 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3d7b6bb-7d89-4cc7-a29d-ae107a4821dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:00.800365 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3d7b6bb-7d89-4cc7-a29d-ae107a4821dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:00.801131 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3d7b6bb-7d89-4cc7-a29d-ae107a4821dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:00.801572 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3d7b6bb-7d89-4cc7-a29d-ae107a4821dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:00.827347 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c3d7b6bb-7d89-4cc7-a29d-ae107a4821dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:42:01.089965 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c3d7b6bb-7d89-4cc7-a29d-ae107a4821dd tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 204 len: 0 microversion: 2.1 time: 0.301832 May 26 19:42:01.090550 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 259/528] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:42:00 2022] DELETE /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:42:01.099755 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-469ccca2-b5d0-4796-a43b-de9e78f27fd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:01.100490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-469ccca2-b5d0-4796-a43b-de9e78f27fd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:01.106378 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-469ccca2-b5d0-4796-a43b-de9e78f27fd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:01.106817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-469ccca2-b5d0-4796-a43b-de9e78f27fd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:01.107611 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-469ccca2-b5d0-4796-a43b-de9e78f27fd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:01.108046 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-469ccca2-b5d0-4796-a43b-de9e78f27fd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:01.253637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-469ccca2-b5d0-4796-a43b-de9e78f27fd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:01.261853 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-469ccca2-b5d0-4796-a43b-de9e78f27fd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1506 microversion: 2.1 time: 0.166888 May 26 19:42:01.262434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 270/529] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:01 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:02.280585 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f1890684-5b84-4193-9f82-ebba5bb3edd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:02.281283 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f1890684-5b84-4193-9f82-ebba5bb3edd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:02.288181 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1890684-5b84-4193-9f82-ebba5bb3edd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:02.288628 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1890684-5b84-4193-9f82-ebba5bb3edd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:02.289386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1890684-5b84-4193-9f82-ebba5bb3edd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:02.289846 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1890684-5b84-4193-9f82-ebba5bb3edd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:02.420962 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f1890684-5b84-4193-9f82-ebba5bb3edd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:02.428997 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f1890684-5b84-4193-9f82-ebba5bb3edd0 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1506 microversion: 2.1 time: 0.153676 May 26 19:42:02.429571 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 260/530] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:02 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:03.135207 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1894891812", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1378612-5a59-4b7c-a0f1-5080210638d6"}], "security_groups": [{"name": "tempest-securitygroup--1419551516"}], "key_name": "tempest-keypair-607719719", "user_data": "}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:03.239523 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] validate_networks() for [('f1378612-5a59-4b7c-a0f1-5080210638d6', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:42:03.446086 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4ae04a7d-1141-4d9c-a0ec-ff5db2af6883 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:03.446722 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4ae04a7d-1141-4d9c-a0ec-ff5db2af6883 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:03.453296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ae04a7d-1141-4d9c-a0ec-ff5db2af6883 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:03.457679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ae04a7d-1141-4d9c-a0ec-ff5db2af6883 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:03.457679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ae04a7d-1141-4d9c-a0ec-ff5db2af6883 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:03.457679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4ae04a7d-1141-4d9c-a0ec-ff5db2af6883 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:03.618406 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4ae04a7d-1141-4d9c-a0ec-ff5db2af6883 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:03.626628 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4ae04a7d-1141-4d9c-a0ec-ff5db2af6883 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1506 microversion: 2.1 time: 0.184410 May 26 19:42:03.627240 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 261/531] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:03 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:03.643719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:42:03.644143 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:42:03.644653 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:42:03.645062 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:42:03.645476 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:42:03.654497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:03.654975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:03.655807 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:03.656245 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:03.663605 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:03.674623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Getting quotas for project b189404964f64aa88af37e536c1c7464. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:42:03.678655 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Getting quotas for user a1327d80a17743daa137acaad895cd51 and project b189404964f64aa88af37e536c1c7464. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:42:03.690276 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:42:03.692567 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:42:03.858128 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d4d3e219-1499-4005-bd59-ac272f63b551 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.727207 May 26 19:42:03.858684 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 271/532] 10.222.0.72 () {62 vars in 1187 bytes} [Thu May 26 19:42:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 19:42:03.869995 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7b0e4707-cb47-4f35-afcd-b121f3370f7b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:03.870740 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7b0e4707-cb47-4f35-afcd-b121f3370f7b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:03.963973 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7b0e4707-cb47-4f35-afcd-b121f3370f7b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:03.973166 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7b0e4707-cb47-4f35-afcd-b121f3370f7b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:03.974757 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7b0e4707-cb47-4f35-afcd-b121f3370f7b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:03.976353 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7b0e4707-cb47-4f35-afcd-b121f3370f7b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1281 microversion: 2.20 time: 0.110424 May 26 19:42:03.977569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 262/533] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:03 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1281 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:04.394591 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-5c084474-cd14-43fa-87ff-476ff2174eaf req-8706210d-960d-4de5-9af5-d7ebbf30425b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdd25a5-210c-4638-95a5-4cf961b1d9d3", "name": "network-vif-deleted", "tag": "4eedf65c-da1c-48d7-8869-d150a6c93ed0"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:04.405502 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-5c084474-cd14-43fa-87ff-476ff2174eaf req-8706210d-960d-4de5-9af5-d7ebbf30425b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:04.416282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-5c084474-cd14-43fa-87ff-476ff2174eaf req-8706210d-960d-4de5-9af5-d7ebbf30425b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:04.417614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-5c084474-cd14-43fa-87ff-476ff2174eaf req-8706210d-960d-4de5-9af5-d7ebbf30425b service nova] Creating event network-vif-deleted:4eedf65c-da1c-48d7-8869-d150a6c93ed0 for instance 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 on hv-cinder-82549 May 26 19:42:04.422634 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-5c084474-cd14-43fa-87ff-476ff2174eaf req-8706210d-960d-4de5-9af5-d7ebbf30425b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032948 May 26 19:42:04.423281 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 272/534] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:04.645949 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:04.647089 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:04.654331 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:04.654777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:04.655567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:04.656001 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:04.695324 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:04.700020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:04.700020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lazy-loading 'fault' on Instance uuid 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:42:04.743950 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:04.752247 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-72215f08-98a5-4231-81ba-b210180da722 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 200 len: 1311 microversion: 2.1 time: 0.110537 May 26 19:42:04.753072 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 263/535] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:04 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:04.994457 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:04.995076 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:05.001245 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:05.002289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:05.003091 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:05.003528 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:05.065291 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:05.073308 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:05.074686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:05.075803 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1ca1556a-b9ba-4eae-8e4b-2cfabfb11a16 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1285 microversion: 2.20 time: 0.086017 May 26 19:42:05.076358 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 273/536] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:04 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:05.769884 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:05.770518 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: 9cdd25a5-210c-4638-95a5-4cf961b1d9d3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:05.776988 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:05.777430 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:05.778223 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:05.778650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:05.795078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] HTTP exception thrown: Instance 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 could not be found. May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Request method failure captured: May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 HTTP/1.1 May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bk-wWCrmDu3OZPPjGfGavhx6ia2Eyb0y9MeDKXOg5P9P_grBQpBxNjv2BirTX3fBsSVTAVkwePvf99LDpsNyrGPxHS5r2J07Cyp_VAt50gwM4c42wDr0Kb3F0ETLaB9On5ikFz8URDxONdpFnJS2OXZ7NgZiRJLg7Vui1vzIRTa2E May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:42:05.796782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bf99d88fec9046608e464a5e2c75506e", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 9a0e96324450438699abfcefec6d1a6d May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 could not be found. May 26 19:42:05.798326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '9cdd25a5-210c-4638-95a5-4cf961b1d9d3'} May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 could not be found. May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:42:05.799233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 could not be found. May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 could not be found. May 26 19:42:05.800591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:05.801878 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Returning 404 to user: Instance 9cdd25a5-210c-4638-95a5-4cf961b1d9d3 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:42:05.801878 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8cfac613-02e9-48a5-95da-4beebec0eccf tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3" status: 404 len: 111 microversion: 2.1 time: 0.032701 May 26 19:42:05.801878 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 264/537] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:05 2022] GET /compute/v2.1/servers/9cdd25a5-210c-4638-95a5-4cf961b1d9d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:42:05.808191 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e4b5296d-d0bd-4457-be55-745a9abdd21f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:05.808736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e4b5296d-d0bd-4457-be55-745a9abdd21f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:05.815924 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4b5296d-d0bd-4457-be55-745a9abdd21f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:05.816369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4b5296d-d0bd-4457-be55-745a9abdd21f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:05.817118 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4b5296d-d0bd-4457-be55-745a9abdd21f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:05.817549 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4b5296d-d0bd-4457-be55-745a9abdd21f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:05.850387 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e4b5296d-d0bd-4457-be55-745a9abdd21f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:42:06.093661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:06.094186 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:06.100191 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:06.100645 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:06.101411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:06.101852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:06.163029 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:06.171078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:06.172600 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:06.174255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0168692b-7ef7-4045-a60a-63936e1a64f0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1333 microversion: 2.20 time: 0.084606 May 26 19:42:06.174806 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 265/538] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:06 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:42:06.198322 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e4b5296d-d0bd-4457-be55-745a9abdd21f tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 204 len: 0 microversion: 2.1 time: 0.393685 May 26 19:42:06.198916 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 274/539] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:42:05 2022] DELETE /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:42:06.206558 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4813788c-f1f6-4352-b3dd-97dcec4bf1ac tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:06.207193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4813788c-f1f6-4352-b3dd-97dcec4bf1ac tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:06.213085 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4813788c-f1f6-4352-b3dd-97dcec4bf1ac tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:06.213578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4813788c-f1f6-4352-b3dd-97dcec4bf1ac tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:06.214343 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4813788c-f1f6-4352-b3dd-97dcec4bf1ac tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:06.214783 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4813788c-f1f6-4352-b3dd-97dcec4bf1ac tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:06.349423 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4813788c-f1f6-4352-b3dd-97dcec4bf1ac tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:06.363874 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4813788c-f1f6-4352-b3dd-97dcec4bf1ac tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.160821 May 26 19:42:06.373951 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 266/540] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:06 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:07.193519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:07.194203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:07.200689 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:07.201129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:07.201879 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:07.202305 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:07.265360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:07.273355 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:07.274861 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:07.275986 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-df16931a-d5fc-4a97-8299-f45f876221b6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1341 microversion: 2.20 time: 0.087320 May 26 19:42:07.276539 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 275/541] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:07 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1341 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:07.381046 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-39104714-6952-4de4-bbb0-29bc38159345 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:07.381656 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-39104714-6952-4de4-bbb0-29bc38159345 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:07.388312 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39104714-6952-4de4-bbb0-29bc38159345 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:07.388810 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39104714-6952-4de4-bbb0-29bc38159345 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:07.389523 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39104714-6952-4de4-bbb0-29bc38159345 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:07.389963 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-39104714-6952-4de4-bbb0-29bc38159345 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:07.531694 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-39104714-6952-4de4-bbb0-29bc38159345 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:07.541124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-39104714-6952-4de4-bbb0-29bc38159345 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.162040 May 26 19:42:07.542950 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 267/542] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:07 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:08.293561 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:08.294161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:08.300640 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:08.301090 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:08.301841 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:08.302276 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:08.365106 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:08.373597 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:08.375134 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:08.380995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c20f27ec-ef1d-47a5-8ede-ddffff4ca936 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1341 microversion: 2.20 time: 0.086653 May 26 19:42:08.380995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 276/543] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:08 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:08.558505 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6b841266-1176-4408-890a-b00e48d3e2fa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:08.559080 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6b841266-1176-4408-890a-b00e48d3e2fa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:08.566207 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b841266-1176-4408-890a-b00e48d3e2fa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:08.566655 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b841266-1176-4408-890a-b00e48d3e2fa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:08.567443 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b841266-1176-4408-890a-b00e48d3e2fa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:08.567877 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b841266-1176-4408-890a-b00e48d3e2fa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:08.692775 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6b841266-1176-4408-890a-b00e48d3e2fa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:08.700171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6b841266-1176-4408-890a-b00e48d3e2fa tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.145649 May 26 19:42:08.700738 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 268/544] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:08 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:09.393779 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:09.394416 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:09.401036 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:09.401466 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:09.403607 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:09.403607 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:09.467179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:09.475237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:09.476749 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:09.477854 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-cee889d6-63e3-4ab4-b9d1-ff4d4d68bf58 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1341 microversion: 2.20 time: 0.088184 May 26 19:42:09.478403 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 277/545] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:09 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1341 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:09.771688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9b9c458f-c885-4591-97af-2c245f79ad22 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:09.772300 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9b9c458f-c885-4591-97af-2c245f79ad22 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:09.778242 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9b9c458f-c885-4591-97af-2c245f79ad22 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:09.778696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9b9c458f-c885-4591-97af-2c245f79ad22 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:09.779493 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9b9c458f-c885-4591-97af-2c245f79ad22 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:09.779937 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9b9c458f-c885-4591-97af-2c245f79ad22 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:09.960054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9b9c458f-c885-4591-97af-2c245f79ad22 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:09.967819 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9b9c458f-c885-4591-97af-2c245f79ad22 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.254960 May 26 19:42:09.979432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 269/546] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:09 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:10.495976 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:10.496613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:10.503583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:10.504023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:10.504776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:10.505210 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:10.568087 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:10.576014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:10.577498 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:10.578620 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-723fb213-047a-46eb-8437-5493e47ebc4c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1339 microversion: 2.20 time: 0.086768 May 26 19:42:10.579331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 278/547] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:10 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:10.985317 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5a43294d-e36c-470c-a402-6a0abd4ba3fe tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:10.986584 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5a43294d-e36c-470c-a402-6a0abd4ba3fe tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:10.993491 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5a43294d-e36c-470c-a402-6a0abd4ba3fe tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:10.993944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5a43294d-e36c-470c-a402-6a0abd4ba3fe tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:10.994711 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5a43294d-e36c-470c-a402-6a0abd4ba3fe tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:10.995169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5a43294d-e36c-470c-a402-6a0abd4ba3fe tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:11.141465 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5a43294d-e36c-470c-a402-6a0abd4ba3fe tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:11.149087 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5a43294d-e36c-470c-a402-6a0abd4ba3fe tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1521 microversion: 2.1 time: 0.167876 May 26 19:42:11.149664 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 270/548] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:10 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:11.328258 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-ffebe2f4-0835-4c8b-9917-8da232d2d3d1 req-f05455e9-6b50-4d3e-b416-e3be8ba7721a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe881d0-23c9-414a-a94b-8be8035792f4", "name": "network-vif-deleted", "tag": "40dd7f56-37e3-4a52-a2d9-f04821553aa0"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:11.336898 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ffebe2f4-0835-4c8b-9917-8da232d2d3d1 req-f05455e9-6b50-4d3e-b416-e3be8ba7721a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:11.337556 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ffebe2f4-0835-4c8b-9917-8da232d2d3d1 req-f05455e9-6b50-4d3e-b416-e3be8ba7721a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:11.350124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-ffebe2f4-0835-4c8b-9917-8da232d2d3d1 req-f05455e9-6b50-4d3e-b416-e3be8ba7721a service nova] Creating event network-vif-deleted:40dd7f56-37e3-4a52-a2d9-f04821553aa0 for instance ebe881d0-23c9-414a-a94b-8be8035792f4 on hv-cinder-82549 May 26 19:42:11.359403 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-ffebe2f4-0835-4c8b-9917-8da232d2d3d1 req-f05455e9-6b50-4d3e-b416-e3be8ba7721a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034685 May 26 19:42:11.360020 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 279/549] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:11.598696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:11.599343 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:11.608486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:11.608929 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:11.609701 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:11.610139 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:11.677035 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:11.678193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:11.684839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:11.685285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:11.686439 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:11.686439 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:11.776750 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Invalid volume: volume 1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4 is already attached to instances: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: POST /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments HTTP/1.1 May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 74 May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:42:11.778470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {"volumeAttachment": {"volumeId": "1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4"}} May 26 19:42:11.780041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Invalid volume: volume 1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4 is already attached to instances: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'server_id': '1aefdfc4-c74d-48dd-8945-bdd21a5c0566', 'body': {'volumeAttachment': {'volumeId': '1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4'}}} May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4 is already attached to instances: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:42:11.784266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4 is already attached to instances: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:11.785639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:11.787027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:11.787027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:42:11.787027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:42:11.787027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4 is already attached to instances: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 May 26 19:42:11.787027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:42:11.787027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 400 to user: Invalid volume: volume 1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4 is already attached to instances: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:42:11.787027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d84ca411-fe1c-4461-8a30-52415c1136df tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107975 May 26 19:42:11.787027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 280/550] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:42:11 2022] POST /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 19:42:11.841730 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e677a41c-f4e9-47fd-939f-d03eddf4dada tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:11.842232 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e677a41c-f4e9-47fd-939f-d03eddf4dada tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:11.849228 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e677a41c-f4e9-47fd-939f-d03eddf4dada tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:11.849609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e677a41c-f4e9-47fd-939f-d03eddf4dada tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:11.850386 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e677a41c-f4e9-47fd-939f-d03eddf4dada tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:11.850833 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e677a41c-f4e9-47fd-939f-d03eddf4dada tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:11.936713 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-e677a41c-f4e9-47fd-939f-d03eddf4dada tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'services' on Instance uuid 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:42:12.125588 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:12.134187 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:12.135787 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:12.136888 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a4ef5310-6b2a-4d6b-9580-704de0998dca tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1407 microversion: 2.20 time: 0.543654 May 26 19:42:12.137452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 271/551] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:11 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1407 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:12.163879 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e677a41c-f4e9-47fd-939f-d03eddf4dada tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments/1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4" status: 202 len: 0 microversion: 2.1 time: 0.325777 May 26 19:42:12.164688 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 281/552] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:42:11 2022] DELETE /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments/1f8e819d-6b96-48ba-9b4e-d9f3a4d394b4 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 19:42:12.170174 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:12.170174 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:12.176990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ab5bc094-4273-4e3d-9968-7139d642bffa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:12.178047 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ab5bc094-4273-4e3d-9968-7139d642bffa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:12.181694 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:12.185772 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab5bc094-4273-4e3d-9968-7139d642bffa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:12.186257 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:12.186409 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab5bc094-4273-4e3d-9968-7139d642bffa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:12.186708 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:12.187486 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab5bc094-4273-4e3d-9968-7139d642bffa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:12.187602 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:12.188005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab5bc094-4273-4e3d-9968-7139d642bffa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:12.188131 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:12.220241 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ab5bc094-4273-4e3d-9968-7139d642bffa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048560 May 26 19:42:12.220852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 282/553] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:42:12 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:42:12.225991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:12.226444 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:12.226891 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lazy-loading 'fault' on Instance uuid ebe881d0-23c9-414a-a94b-8be8035792f4 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:42:12.268916 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0e96324450438699abfcefec6d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf99d88fec9046608e464a5e2c75506e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:12.272477 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:12.276836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-182ce591-b7f0-4669-a800-0a46a49ef43b tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 200 len: 1311 microversion: 2.1 time: 0.114483 May 26 19:42:12.277384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 272/554] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:12 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:42:13.158810 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:13.158810 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:13.165750 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:13.166198 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:13.167000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:13.167432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:13.232666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-95588db9-e45f-47e7-8d17-1503885ab298 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:13.234273 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-95588db9-e45f-47e7-8d17-1503885ab298 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:13.241888 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-95588db9-e45f-47e7-8d17-1503885ab298 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:13.242737 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-95588db9-e45f-47e7-8d17-1503885ab298 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:13.243625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-95588db9-e45f-47e7-8d17-1503885ab298 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:13.244059 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-95588db9-e45f-47e7-8d17-1503885ab298 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:13.275966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-95588db9-e45f-47e7-8d17-1503885ab298 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047605 May 26 19:42:13.278985 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 273/555] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:42:13 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:13.293704 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:13.294340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] [instance: ebe881d0-23c9-414a-a94b-8be8035792f4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:13.303127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:13.303578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:13.304348 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:13.304785 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:13.306188 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:13.315307 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:13.317085 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:13.318416 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-56df33a9-c87e-4873-a4ed-5a979fc85e48 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1407 microversion: 2.20 time: 0.167571 May 26 19:42:13.319245 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 283/556] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:13 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:13.322062 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] HTTP exception thrown: Instance ebe881d0-23c9-414a-a94b-8be8035792f4 could not be found. May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Request method failure captured: May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 HTTP/1.1 May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bk-wWCrmDu3OZPPjGfGavhx6ia2Eyb0y9MeDKXOg5P9P_grBQpBxNjv2BirTX3fBsSVTAVkwePvf99LDpsNyrGPxHS5r2J07Cyp_VAt50gwM4c42wDr0Kb3F0ETLaB9On5ikFz8URDxONdpFnJS2OXZ7NgZiRJLg7Vui1vzIRTa2E May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:42:13.323682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bf99d88fec9046608e464a5e2c75506e", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bf99d88fec9046608e464a5e2c75506e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: bf99d88fec9046608e464a5e2c75506e May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-775047050 May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 9a0e96324450438699abfcefec6d1a6d May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-775047050-project May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance ebe881d0-23c9-414a-a94b-8be8035792f4 could not be found. May 26 19:42:13.325316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'ebe881d0-23c9-414a-a94b-8be8035792f4'} May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe881d0-23c9-414a-a94b-8be8035792f4 could not be found. May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:42:13.326101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe881d0-23c9-414a-a94b-8be8035792f4 could not be found. May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe881d0-23c9-414a-a94b-8be8035792f4 could not be found. May 26 19:42:13.327508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:13.328581 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] Returning 404 to user: Instance ebe881d0-23c9-414a-a94b-8be8035792f4 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:42:13.328581 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-14887066-5240-4711-b4ab-b41657e024b2 tempest-ServerRescueNegativeTestJSON-775047050 tempest-ServerRescueNegativeTestJSON-775047050-project] 10.222.0.72 "GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4" status: 404 len: 111 microversion: 2.1 time: 0.035184 May 26 19:42:13.328581 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 274/557] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:13 2022] GET /compute/v2.1/servers/ebe881d0-23c9-414a-a94b-8be8035792f4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:42:13.375434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-ac2e166f-1367-4b34-80ac-c3dd8aa1d8d0 req-6ed66d09-4580-4239-8f37-9e083cc546ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d37e4a7-2599-4466-b249-a142cf7770f0", "tag": "81fa53c7-4d30-4a24-9182-ad976ec89b2b"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:13.383980 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ac2e166f-1367-4b34-80ac-c3dd8aa1d8d0 req-6ed66d09-4580-4239-8f37-9e083cc546ba service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:13.388650 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ac2e166f-1367-4b34-80ac-c3dd8aa1d8d0 req-6ed66d09-4580-4239-8f37-9e083cc546ba service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:13.395839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-ac2e166f-1367-4b34-80ac-c3dd8aa1d8d0 req-6ed66d09-4580-4239-8f37-9e083cc546ba service nova] Creating event network-changed:81fa53c7-4d30-4a24-9182-ad976ec89b2b for instance 7d37e4a7-2599-4466-b249-a142cf7770f0 on hv-cinder-82549 May 26 19:42:13.400561 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-ac2e166f-1367-4b34-80ac-c3dd8aa1d8d0 req-6ed66d09-4580-4239-8f37-9e083cc546ba service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028877 May 26 19:42:13.401200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 284/558] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:14.288580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8d1a55d8-2bfa-4a85-857a-64a7f5bf9527 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:14.289492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8d1a55d8-2bfa-4a85-857a-64a7f5bf9527 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:14.292323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:14.296974 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8d1a55d8-2bfa-4a85-857a-64a7f5bf9527 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:14.297428 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8d1a55d8-2bfa-4a85-857a-64a7f5bf9527 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:14.298190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8d1a55d8-2bfa-4a85-857a-64a7f5bf9527 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:14.299341 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8d1a55d8-2bfa-4a85-857a-64a7f5bf9527 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:14.328960 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8d1a55d8-2bfa-4a85-857a-64a7f5bf9527 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044693 May 26 19:42:14.329734 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 275/559] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:42:14 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 19:42:14.338364 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:14.340108 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=10 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:14.346418 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:14.347909 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:14.356081 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:14.362029 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:14.362029 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:14.362029 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:14.399927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c48e8006-5117-4ca2-b040-3b8fcab94214 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:14.400534 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c48e8006-5117-4ca2-b040-3b8fcab94214 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:14.408296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c48e8006-5117-4ca2-b040-3b8fcab94214 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:14.413823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c48e8006-5117-4ca2-b040-3b8fcab94214 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:14.413823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c48e8006-5117-4ca2-b040-3b8fcab94214 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:14.413823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c48e8006-5117-4ca2-b040-3b8fcab94214 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:14.437460 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c48e8006-5117-4ca2-b040-3b8fcab94214 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:42:14.598542 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:14.609408 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:14.611119 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:14.612492 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-cf8a106c-6a46-463b-8784-b92722ad59a7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1407 microversion: 2.20 time: 0.277330 May 26 19:42:14.613157 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 285/560] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:14 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:14.700495 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:14.771956 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c48e8006-5117-4ca2-b040-3b8fcab94214 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 204 len: 0 microversion: 2.1 time: 0.375753 May 26 19:42:14.772843 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 276/561] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:42:14 2022] DELETE /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 19:42:14.787057 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-39a1456f-ce14-4d52-828d-0a574505c6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:14.790250 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-39a1456f-ce14-4d52-828d-0a574505c6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:14.794341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-39a1456f-ce14-4d52-828d-0a574505c6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:14.795053 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-39a1456f-ce14-4d52-828d-0a574505c6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:14.795883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-39a1456f-ce14-4d52-828d-0a574505c6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:14.796466 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-39a1456f-ce14-4d52-828d-0a574505c6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:15.036064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-39a1456f-ce14-4d52-828d-0a574505c6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:15.043449 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-39a1456f-ce14-4d52-828d-0a574505c6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1681 microversion: 2.1 time: 0.266227 May 26 19:42:15.044684 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 286/562] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:14 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1681 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:15.631411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:15.632402 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:15.639887 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:15.640416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:15.641301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:15.641800 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:15.786031 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:15.795081 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:15.796593 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:15.797716 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-93569295-84cd-4870-a077-79a8e0821f86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1407 microversion: 2.20 time: 0.170659 May 26 19:42:15.798278 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 277/563] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:15 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:16.060190 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-92b0e290-fd81-4c06-91f8-b16ca8b6ee35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:16.060802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-92b0e290-fd81-4c06-91f8-b16ca8b6ee35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:16.068023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-92b0e290-fd81-4c06-91f8-b16ca8b6ee35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:16.068474 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-92b0e290-fd81-4c06-91f8-b16ca8b6ee35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:16.069270 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-92b0e290-fd81-4c06-91f8-b16ca8b6ee35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:16.069707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-92b0e290-fd81-4c06-91f8-b16ca8b6ee35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:16.283736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-92b0e290-fd81-4c06-91f8-b16ca8b6ee35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:16.291272 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-92b0e290-fd81-4c06-91f8-b16ca8b6ee35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1681 microversion: 2.1 time: 0.234908 May 26 19:42:16.291841 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 287/564] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:16 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:16.817418 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:16.818036 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:16.834035 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:16.834979 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:16.836748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:16.839452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:17.101155 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:17.109486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:17.112027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:17.113386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f33d242e-4afd-4878-9614-81a59521b44b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1407 microversion: 2.20 time: 0.300608 May 26 19:42:17.124125 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 278/565] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:16 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:17.308492 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9323368f-9d86-4047-8fc8-98469b14599f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:17.309047 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9323368f-9d86-4047-8fc8-98469b14599f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:17.319878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9323368f-9d86-4047-8fc8-98469b14599f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:17.320613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9323368f-9d86-4047-8fc8-98469b14599f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:17.321563 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9323368f-9d86-4047-8fc8-98469b14599f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:17.322667 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9323368f-9d86-4047-8fc8-98469b14599f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:17.356538 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:17.580495 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9323368f-9d86-4047-8fc8-98469b14599f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:17.588207 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9323368f-9d86-4047-8fc8-98469b14599f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1681 microversion: 2.1 time: 0.283648 May 26 19:42:17.588867 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 288/566] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:17 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1681 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:17.806045 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-0ae13d6b-e74b-4e89-a1b9-a1a96bc6cb42 req-c3a755c7-a445-491b-b0b3-b771415c7858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aefdfc4-c74d-48dd-8945-bdd21a5c0566", "name": "network-vif-deleted", "tag": "13d90f7c-15e0-429a-a8cd-b7ec2c9a22a1"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:17.814724 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-0ae13d6b-e74b-4e89-a1b9-a1a96bc6cb42 req-c3a755c7-a445-491b-b0b3-b771415c7858 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:17.815131 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-0ae13d6b-e74b-4e89-a1b9-a1a96bc6cb42 req-c3a755c7-a445-491b-b0b3-b771415c7858 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:17.828879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-0ae13d6b-e74b-4e89-a1b9-a1a96bc6cb42 req-c3a755c7-a445-491b-b0b3-b771415c7858 service nova] Creating event network-vif-deleted:13d90f7c-15e0-429a-a8cd-b7ec2c9a22a1 for instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 on hv-cinder-82549 May 26 19:42:17.834254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-0ae13d6b-e74b-4e89-a1b9-a1a96bc6cb42 req-c3a755c7-a445-491b-b0b3-b771415c7858 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031941 May 26 19:42:17.836066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 279/567] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:42:18.132516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:18.133126 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:18.141104 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:18.141104 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:18.155997 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:18.156384 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:18.310264 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:18.321288 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:18.323417 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:18.324995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-59ca6b42-e991-45eb-9e2d-1b5187a3da12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1407 microversion: 2.20 time: 0.196459 May 26 19:42:18.326013 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 289/568] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:18 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:18.606752 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:18.607512 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:18.614552 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:18.615035 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:18.615809 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:18.616246 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:18.648276 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:18.648723 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:18.650367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:42:18.693054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:18.700894 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-458c18f7-feaa-4663-a3e2-5be558e7c63a tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 200 len: 1330 microversion: 2.1 time: 0.098933 May 26 19:42:18.705991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 280/569] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:18 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:19.346167 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:19.346988 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:19.354542 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:19.355289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:19.356288 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:19.356862 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:19.387277 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-70b21ba7-62b7-4127-b35a-45a9ad3b593c req-6920caf4-58e8-42d7-8bfd-5007f50bd370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d37e4a7-2599-4466-b249-a142cf7770f0", "name": "network-vif-plugged", "status": "completed", "tag": "81fa53c7-4d30-4a24-9182-ad976ec89b2b"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:19.397884 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-70b21ba7-62b7-4127-b35a-45a9ad3b593c req-6920caf4-58e8-42d7-8bfd-5007f50bd370 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:19.398768 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-70b21ba7-62b7-4127-b35a-45a9ad3b593c req-6920caf4-58e8-42d7-8bfd-5007f50bd370 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:19.415599 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-70b21ba7-62b7-4127-b35a-45a9ad3b593c req-6920caf4-58e8-42d7-8bfd-5007f50bd370 service nova] Creating event network-vif-plugged:81fa53c7-4d30-4a24-9182-ad976ec89b2b for instance 7d37e4a7-2599-4466-b249-a142cf7770f0 on hv-cinder-82549 May 26 19:42:19.420985 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-70b21ba7-62b7-4127-b35a-45a9ad3b593c req-6920caf4-58e8-42d7-8bfd-5007f50bd370 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039215 May 26 19:42:19.421636 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 281/570] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:19.502859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:19.511193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:19.513310 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:19.514477 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e6aaea8b-d179-4feb-9046-71595e22f6bf tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1407 microversion: 2.20 time: 0.172932 May 26 19:42:19.515245 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 290/571] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:19 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:19.718034 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:19.718833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:19.725893 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:19.726415 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:19.727284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:19.727785 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:19.741125 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 HTTP/1.1 May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:42:19.743149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:42:19.744670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '1aefdfc4-c74d-48dd-8945-bdd21a5c0566'} May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:42:19.745520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:42:19.747039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:19.748432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:42:19.748432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3655d862-67a4-44d8-a555-67df2d0b14c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 404 len: 111 microversion: 2.1 time: 0.030846 May 26 19:42:19.748654 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 282/572] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:19 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:42:19.753834 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6b7c5938-d670-4d49-8ba2-d0152364a0c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '.version_select at 0x7fa788226040>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:19.845600 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6b7c5938-d670-4d49-8ba2-d0152364a0c2 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884081685" status: 202 len: 0 microversion: 2.1 time: 0.095578 May 26 19:42:19.846709 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 291/573] 10.222.0.72 () {58 vars in 1217 bytes} [Thu May 26 19:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884081685 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:42:20.531968 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:20.532663 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:20.539645 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:20.540306 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:20.541081 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:20.541518 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:20.748746 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:20.757734 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:20.759405 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:20.760615 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-818900d2-90f5-474a-aba0-272cb0f42d75 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1407 microversion: 2.20 time: 0.232787 May 26 19:42:20.772549 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 283/574] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:20 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:20.777346 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-91a3d822-6cb6-403b-ab5f-ab4d84f75804 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:20.777924 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-91a3d822-6cb6-403b-ab5f-ab4d84f75804 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:20.785221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91a3d822-6cb6-403b-ab5f-ab4d84f75804 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:20.785747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91a3d822-6cb6-403b-ab5f-ab4d84f75804 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:20.786591 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91a3d822-6cb6-403b-ab5f-ab4d84f75804 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:20.787184 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91a3d822-6cb6-403b-ab5f-ab4d84f75804 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:20.817794 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-91a3d822-6cb6-403b-ab5f-ab4d84f75804 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:42:20.865760 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6c6edccf-a5bb-4250-ad97-d0d7f09a2294 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: .version_select at 0x7fa7881faaf0>, body: {"keypair": {"name": "tempest-keypair-922826672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpllQm9oKZDHiEIO/VzUsvFcdeR8Xex41+zuCHwFRPsF5SpGFinI0cPUBTYVw1PYtttUZGNvrbukOXAU1FV7wgqihSvmBupOvwXHqbSjq0pisx36k6ofxvnrCH6+F9Ekg=="}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:20.885515 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-6c6edccf-a5bb-4250-ad97-d0d7f09a2294 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:42:20.893672 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-6c6edccf-a5bb-4250-ad97-d0d7f09a2294 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for user 841abe37b81f47d2a95140e46b12ea08 and project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:42:21.034095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6c6edccf-a5bb-4250-ad97-d0d7f09a2294 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176808 May 26 19:42:21.034696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 284/575] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:42:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:21.170494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-91a3d822-6cb6-403b-ab5f-ab4d84f75804 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "DELETE /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 204 len: 0 microversion: 2.1 time: 0.396860 May 26 19:42:21.171314 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 292/576] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:42:20 2022] DELETE /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:42:21.180188 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ba4a0215-9c12-4031-8653-ff757b7f6256 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:21.182779 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ba4a0215-9c12-4031-8653-ff757b7f6256 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:21.187955 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ba4a0215-9c12-4031-8653-ff757b7f6256 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:21.188415 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ba4a0215-9c12-4031-8653-ff757b7f6256 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:21.189775 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ba4a0215-9c12-4031-8653-ff757b7f6256 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:21.190232 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ba4a0215-9c12-4031-8653-ff757b7f6256 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:21.346090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ba4a0215-9c12-4031-8653-ff757b7f6256 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:21.356977 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ba4a0215-9c12-4031-8653-ff757b7f6256 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1578 microversion: 2.1 time: 0.180872 May 26 19:42:21.358643 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 285/577] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:21 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:21.779890 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:21.780798 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:21.787690 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:21.788143 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:21.788917 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:21.789363 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:22.049962 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:22.062398 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:22.064031 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:22.065950 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c28c4041-69f2-4644-b4cf-800220675f02 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1600 microversion: 2.20 time: 0.290344 May 26 19:42:22.066519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 293/578] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:42:21 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1600 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:42:22.084496 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d705c18e-15bf-4678-a67e-872d3d006c9f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:22.085536 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d705c18e-15bf-4678-a67e-872d3d006c9f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:22.098651 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d705c18e-15bf-4678-a67e-872d3d006c9f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:22.098651 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d705c18e-15bf-4678-a67e-872d3d006c9f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:22.098651 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d705c18e-15bf-4678-a67e-872d3d006c9f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:22.098651 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d705c18e-15bf-4678-a67e-872d3d006c9f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:22.182942 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d705c18e-15bf-4678-a67e-872d3d006c9f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103282 May 26 19:42:22.188223 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 286/579] 10.222.0.72 () {60 vars in 1315 bytes} [Thu May 26 19:42:22 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:42:22.377461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9b59c7fd-29b8-477c-8a01-39e151c103af tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:22.378554 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9b59c7fd-29b8-477c-8a01-39e151c103af tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:22.385434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9b59c7fd-29b8-477c-8a01-39e151c103af tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:22.385941 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9b59c7fd-29b8-477c-8a01-39e151c103af tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:22.386752 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9b59c7fd-29b8-477c-8a01-39e151c103af tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:22.387297 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9b59c7fd-29b8-477c-8a01-39e151c103af tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:22.571155 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9b59c7fd-29b8-477c-8a01-39e151c103af tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:22.586059 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9b59c7fd-29b8-477c-8a01-39e151c103af tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1578 microversion: 2.1 time: 0.213751 May 26 19:42:22.586788 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 294/580] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:22 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:23.613593 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4a7f340f-dc9d-43a6-a860-00b3a99595ae tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:23.615384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4a7f340f-dc9d-43a6-a860-00b3a99595ae tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:23.622927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4a7f340f-dc9d-43a6-a860-00b3a99595ae tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:23.623628 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4a7f340f-dc9d-43a6-a860-00b3a99595ae tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:23.624797 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4a7f340f-dc9d-43a6-a860-00b3a99595ae tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:23.625429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4a7f340f-dc9d-43a6-a860-00b3a99595ae tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:23.999699 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4a7f340f-dc9d-43a6-a860-00b3a99595ae tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:24.009998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4a7f340f-dc9d-43a6-a860-00b3a99595ae tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1578 microversion: 2.1 time: 0.408732 May 26 19:42:24.011295 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 287/581] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:23 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1578 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:24.876074 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-8e6fa668-2bc0-4941-a855-d142f4cea5f3 req-66586ea8-6417-4bd4-a380-9cab5f151c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d37e4a7-2599-4466-b249-a142cf7770f0", "tag": "81fa53c7-4d30-4a24-9182-ad976ec89b2b"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:24.886767 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-8e6fa668-2bc0-4941-a855-d142f4cea5f3 req-66586ea8-6417-4bd4-a380-9cab5f151c13 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:24.887554 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-8e6fa668-2bc0-4941-a855-d142f4cea5f3 req-66586ea8-6417-4bd4-a380-9cab5f151c13 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:24.908275 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-8e6fa668-2bc0-4941-a855-d142f4cea5f3 req-66586ea8-6417-4bd4-a380-9cab5f151c13 service nova] Creating event network-changed:81fa53c7-4d30-4a24-9182-ad976ec89b2b for instance 7d37e4a7-2599-4466-b249-a142cf7770f0 on hv-cinder-82549 May 26 19:42:24.918471 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-8e6fa668-2bc0-4941-a855-d142f4cea5f3 req-66586ea8-6417-4bd4-a380-9cab5f151c13 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341553 May 26 19:42:24.929058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 295/582] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:25.028503 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5d346ac4-2aa1-4efb-968c-06665cbf437e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:25.029040 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5d346ac4-2aa1-4efb-968c-06665cbf437e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:25.037718 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5d346ac4-2aa1-4efb-968c-06665cbf437e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:25.038234 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5d346ac4-2aa1-4efb-968c-06665cbf437e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:25.039175 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5d346ac4-2aa1-4efb-968c-06665cbf437e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:25.039609 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5d346ac4-2aa1-4efb-968c-06665cbf437e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:25.128332 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5d346ac4-2aa1-4efb-968c-06665cbf437e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:25.145184 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5d346ac4-2aa1-4efb-968c-06665cbf437e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1510 microversion: 2.1 time: 0.118090 May 26 19:42:25.146936 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 288/583] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:25 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1510 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:26.165214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8eb0ae72-daa3-43a0-a82d-c48297d078b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:26.166575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8eb0ae72-daa3-43a0-a82d-c48297d078b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:26.193297 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8eb0ae72-daa3-43a0-a82d-c48297d078b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:26.200280 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1570200231", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ddf1778-5518-469d-acdc-1047098dc517"}], "security_groups": [{"name": "tempest-securitygroup--1587397163"}], "key_name": "tempest-keypair-922826672", "user_data": "}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:26.207097 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8eb0ae72-daa3-43a0-a82d-c48297d078b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:26.208537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8eb0ae72-daa3-43a0-a82d-c48297d078b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:26.211632 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8eb0ae72-daa3-43a0-a82d-c48297d078b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:26.334316 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8eb0ae72-daa3-43a0-a82d-c48297d078b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:26.364145 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8eb0ae72-daa3-43a0-a82d-c48297d078b5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 200 len: 1226 microversion: 2.1 time: 0.193850 May 26 19:42:26.364145 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 296/584] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:26 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:26.410697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] validate_networks() for [('2ddf1778-5518-469d-acdc-1047098dc517', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:42:26.969346 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-05b3342c-0489-44eb-8db2-cf80dba6a2ee req-87d65865-dee2-443c-a788-01667c3d3cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d24bae-e684-487b-88b1-c134195fe54f", "name": "network-vif-deleted", "tag": "c9b0aa22-b532-4ac9-a353-da7eed5a3b37"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:26.976802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-05b3342c-0489-44eb-8db2-cf80dba6a2ee req-87d65865-dee2-443c-a788-01667c3d3cfb service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:26.977247 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-05b3342c-0489-44eb-8db2-cf80dba6a2ee req-87d65865-dee2-443c-a788-01667c3d3cfb service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:26.990850 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-05b3342c-0489-44eb-8db2-cf80dba6a2ee req-87d65865-dee2-443c-a788-01667c3d3cfb service nova] Creating event network-vif-deleted:c9b0aa22-b532-4ac9-a353-da7eed5a3b37 for instance 41d24bae-e684-487b-88b1-c134195fe54f on hv-cinder-82549 May 26 19:42:26.996170 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-05b3342c-0489-44eb-8db2-cf80dba6a2ee req-87d65865-dee2-443c-a788-01667c3d3cfb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034598 May 26 19:42:26.996939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 297/585] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:27.056732 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-771e3582-6c64-4be4-ba52-b02432cc6a92 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'create', calling method: .version_select at 0x7fa7881a29d0>, body: {"keypair": {"name": "tempest-keypair-1480506312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMoavRzXjy+vddrr2FLvAyXivJvKWa6RlxDR1iDdAa/uFsLPTj34/Qa3UNBKb19h1yFRVYW6eLRDoitbUfARjIaO2iB0FJBb943fpXZnXe5aGYvF6QLVuGMpLoVy0ZDmA=="}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:27.075214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-771e3582-6c64-4be4-ba52-b02432cc6a92 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Getting quotas for project f6d58e80c3594ae2abb49ade4482dfd3. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:42:27.080433 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-771e3582-6c64-4be4-ba52-b02432cc6a92 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Getting quotas for user 72991fbdeb3d41e6929ad2d6f3c1aaf6 and project f6d58e80c3594ae2abb49ade4482dfd3. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:42:27.107280 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:42:27.107705 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:42:27.108175 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:42:27.108587 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:42:27.108992 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:42:27.122560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:27.122560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:27.122560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:27.122560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:27.137832 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:42:27.142069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Getting quotas for user 841abe37b81f47d2a95140e46b12ea08 and project 39f75b0f65c4475ba2d5dc1e7ae203ba. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:42:27.156377 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:42:27.158700 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:42:27.203702 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-771e3582-6c64-4be4-ba52-b02432cc6a92 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.202799 May 26 19:42:27.211321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 298/586] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:42:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:27.320328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-283ff4f8-bd3a-4364-8ade-9fba84002025 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.125367 May 26 19:42:27.320983 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 289/587] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:42:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 19:42:27.331220 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-175036f5-0904-4446-a119-65205ad570aa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:27.331944 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-175036f5-0904-4446-a119-65205ad570aa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:27.383491 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:27.383626 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:27.401272 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-175036f5-0904-4446-a119-65205ad570aa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:27.405246 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:27.405701 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:27.411900 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:27.411900 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:27.419899 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-175036f5-0904-4446-a119-65205ad570aa tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1241 microversion: 2.1 time: 0.092665 May 26 19:42:27.431105 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 299/588] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:27 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:27.433284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] HTTP exception thrown: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Request method failure captured: May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f HTTP/1.1 May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9dODe5177Owy3dpm-4gbvmIKgYtSpVzffHNxVZXJ-h64nADjxTGo92T5LEKufth1ZKSjB--VZugjOSvzN6X7t_ghsD9lzjjp8X9KlWmg_jE4tL1voONS0j2SXg0ZIODQzxRbDh6J8ZcC1BNj2GcPLfDY4TxW6XXy5TlSRX-rIgsJBY May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:42:27.442853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_dabc38fc95184250b1d9e7090ab73b2c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-TestVolumeBootPattern-128423126 May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-TestVolumeBootPattern-128423126-project May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: fe347ddb98df4018b1b9d65db314d8d8 May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-TestVolumeBootPattern-128423126-project May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:42:27.444625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '41d24bae-e684-487b-88b1-c134195fe54f'} May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:42:27.445676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:42:27.447173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:42:27.448543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Returning 404 to user: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:42:27.448543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b21e6c62-5474-4d53-b152-05e2790222b3 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 404 len: 111 microversion: 2.1 time: 0.075580 May 26 19:42:27.457649 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 290/589] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:27 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:42:27.576089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1071322846", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1830455866", "security_groups": [{"name": "tempest-secgroup-smoke-1989480405"}], "block_device_mapping_v2": [{"uuid": "0e48efb7-5104-43fa-98de-a2faaacc4b64", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "492a2884-9243-465b-939b-ac60c35b4b3f"}]}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:27.699359 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] validate_networks() for [('492a2884-9243-465b-939b-ac60c35b4b3f', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:42:28.188817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:42:28.189248 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:42:28.191992 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:42:28.199321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:42:28.199321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:42:28.204201 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:28.205313 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:28.206087 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:28.206523 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:28.225224 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Getting quotas for project dabc38fc95184250b1d9e7090ab73b2c. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:42:28.229570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Getting quotas for user fe347ddb98df4018b1b9d65db314d8d8 and project dabc38fc95184250b1d9e7090ab73b2c. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:42:28.290315 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:42:28.292555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e48efb7-5104-43fa-98de-a2faaacc4b64',volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:42:28.437686 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9aba2fc5-f076-4cf5-9980-ebb884ca1bb7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:28.438342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9aba2fc5-f076-4cf5-9980-ebb884ca1bb7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:28.492137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9aba2fc5-f076-4cf5-9980-ebb884ca1bb7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:28.499570 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9aba2fc5-f076-4cf5-9980-ebb884ca1bb7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1241 microversion: 2.1 time: 0.065848 May 26 19:42:28.503880 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 291/590] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:28 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:42:28.883030 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-84522f9b-7935-467e-9cb7-b3187fe8e2db tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.310825 May 26 19:42:28.897488 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-023832b0-bb44-4198-a838-2fce72bada1a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:28.898524 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-023832b0-bb44-4198-a838-2fce72bada1a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:28.900654 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 300/591] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:42:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:42:28.989792 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-023832b0-bb44-4198-a838-2fce72bada1a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:29.006775 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-023832b0-bb44-4198-a838-2fce72bada1a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1095 microversion: 2.1 time: 0.107945 May 26 19:42:29.006775 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 292/592] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:28 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1095 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:29.519488 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-08a851c2-e0d0-438f-b43a-8088676d62c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:29.520165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-08a851c2-e0d0-438f-b43a-8088676d62c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:29.530084 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-08a851c2-e0d0-438f-b43a-8088676d62c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:29.530809 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-08a851c2-e0d0-438f-b43a-8088676d62c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:29.532106 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-08a851c2-e0d0-438f-b43a-8088676d62c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:29.533780 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-08a851c2-e0d0-438f-b43a-8088676d62c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:29.619243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-08a851c2-e0d0-438f-b43a-8088676d62c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:29.628239 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-08a851c2-e0d0-438f-b43a-8088676d62c4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1293 microversion: 2.1 time: 0.113994 May 26 19:42:29.629851 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 301/593] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:29 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:30.017650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c631e000-a245-4c37-a7d7-70ca840cb78c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:30.018296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c631e000-a245-4c37-a7d7-70ca840cb78c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:30.026604 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c631e000-a245-4c37-a7d7-70ca840cb78c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:30.027310 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c631e000-a245-4c37-a7d7-70ca840cb78c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:30.028292 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c631e000-a245-4c37-a7d7-70ca840cb78c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:30.028834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c631e000-a245-4c37-a7d7-70ca840cb78c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:30.132891 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c631e000-a245-4c37-a7d7-70ca840cb78c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:30.157196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c631e000-a245-4c37-a7d7-70ca840cb78c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1145 microversion: 2.1 time: 0.141798 May 26 19:42:30.160213 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 293/594] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:30 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1145 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:30.592960 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-900796361", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d90aacf-7ed7-4464-b873-af570bc85444"}], "security_groups": [{"name": "tempest-securitygroup--1273572806"}], "key_name": "tempest-keypair-1480506312", "user_data": "}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:30.645089 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4425753f-d7d0-47af-bbd4-6f07cfc12aa7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:30.645698 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4425753f-d7d0-47af-bbd4-6f07cfc12aa7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:30.662770 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4425753f-d7d0-47af-bbd4-6f07cfc12aa7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:30.663289 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4425753f-d7d0-47af-bbd4-6f07cfc12aa7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:30.664014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4425753f-d7d0-47af-bbd4-6f07cfc12aa7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:30.664447 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4425753f-d7d0-47af-bbd4-6f07cfc12aa7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:30.716336 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] validate_networks() for [('3d90aacf-7ed7-4464-b873-af570bc85444', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:42:30.731354 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4425753f-d7d0-47af-bbd4-6f07cfc12aa7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:30.735157 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:30.740690 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4425753f-d7d0-47af-bbd4-6f07cfc12aa7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1299 microversion: 2.1 time: 0.099688 May 26 19:42:30.741503 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 294/595] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:30 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:31.179075 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-decbf5c4-9928-4835-a104-392823639351 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:31.183479 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-decbf5c4-9928-4835-a104-392823639351 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:31.188763 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-decbf5c4-9928-4835-a104-392823639351 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:31.189322 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-decbf5c4-9928-4835-a104-392823639351 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:31.190277 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-decbf5c4-9928-4835-a104-392823639351 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:31.190696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-decbf5c4-9928-4835-a104-392823639351 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:31.229935 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:42:31.230175 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:42:31.230533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:42:31.231140 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:42:31.231709 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:42:31.248734 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:31.249422 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:31.251386 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:31.252024 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:31.284056 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Getting quotas for project f6d58e80c3594ae2abb49ade4482dfd3. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:42:31.288261 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Getting quotas for user 72991fbdeb3d41e6929ad2d6f3c1aaf6 and project f6d58e80c3594ae2abb49ade4482dfd3. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:42:31.299609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:42:31.301688 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:42:31.369707 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-decbf5c4-9928-4835-a104-392823639351 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:31.382003 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-decbf5c4-9928-4835-a104-392823639351 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1201 microversion: 2.1 time: 0.209036 May 26 19:42:31.382604 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 295/596] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:31 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1201 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:42:31.465048 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e6d2f56c-d899-4d39-b821-5d6d28a39c93 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.876360 May 26 19:42:31.465732 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 302/597] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:42:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:42:31.476228 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0db1d45c-7d2d-4502-b818-04fae1668141 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:31.477013 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0db1d45c-7d2d-4502-b818-04fae1668141 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:31.598958 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0db1d45c-7d2d-4502-b818-04fae1668141 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:31.607821 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0db1d45c-7d2d-4502-b818-04fae1668141 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1237 microversion: 2.1 time: 0.136004 May 26 19:42:31.617522 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 296/598] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:31 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1237 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:31.758821 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9ec15144-3191-48ba-b18b-c8b7ca9eb334 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:31.759499 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9ec15144-3191-48ba-b18b-c8b7ca9eb334 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:31.766200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9ec15144-3191-48ba-b18b-c8b7ca9eb334 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:31.771671 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9ec15144-3191-48ba-b18b-c8b7ca9eb334 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:31.771671 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9ec15144-3191-48ba-b18b-c8b7ca9eb334 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:31.771671 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9ec15144-3191-48ba-b18b-c8b7ca9eb334 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:31.898320 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9ec15144-3191-48ba-b18b-c8b7ca9eb334 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:31.905624 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9ec15144-3191-48ba-b18b-c8b7ca9eb334 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1367 microversion: 2.1 time: 0.151298 May 26 19:42:31.906961 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 303/599] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:31 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:32.399122 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fabb5173-f3b6-4575-bbc8-9029960a7e5c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:32.399732 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fabb5173-f3b6-4575-bbc8-9029960a7e5c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:32.406245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fabb5173-f3b6-4575-bbc8-9029960a7e5c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:32.406738 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fabb5173-f3b6-4575-bbc8-9029960a7e5c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:32.408019 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fabb5173-f3b6-4575-bbc8-9029960a7e5c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:32.408455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fabb5173-f3b6-4575-bbc8-9029960a7e5c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:32.480538 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-7b287109-e01b-4376-9402-f62318e62294 req-db557edc-6f02-43a5-bdda-49edfd3fbaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b3cb81-bd61-4e0e-bb00-6c40deb52f1b", "tag": "c5e1749f-1285-4e41-9fd3-c9a4834b4493"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:32.491199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-7b287109-e01b-4376-9402-f62318e62294 req-db557edc-6f02-43a5-bdda-49edfd3fbaef service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:32.491638 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-7b287109-e01b-4376-9402-f62318e62294 req-db557edc-6f02-43a5-bdda-49edfd3fbaef service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:32.504559 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-7b287109-e01b-4376-9402-f62318e62294 req-db557edc-6f02-43a5-bdda-49edfd3fbaef service nova] Creating event network-changed:c5e1749f-1285-4e41-9fd3-c9a4834b4493 for instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b on hv-cinder-82549 May 26 19:42:32.510375 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-7b287109-e01b-4376-9402-f62318e62294 req-db557edc-6f02-43a5-bdda-49edfd3fbaef service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040396 May 26 19:42:32.511522 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 304/600] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:32.625533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0a31c63a-9768-423c-8a71-2e856cb25fee tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:32.626236 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0a31c63a-9768-423c-8a71-2e856cb25fee tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:32.655249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:32.707348 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0a31c63a-9768-423c-8a71-2e856cb25fee tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:32.714808 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0a31c63a-9768-423c-8a71-2e856cb25fee tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1237 microversion: 2.1 time: 0.093333 May 26 19:42:32.716996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 305/601] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:32 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:42:32.804953 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fabb5173-f3b6-4575-bbc8-9029960a7e5c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:32.813492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fabb5173-f3b6-4575-bbc8-9029960a7e5c tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1279 microversion: 2.1 time: 0.418480 May 26 19:42:32.814866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 297/602] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:32 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1279 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:32.922270 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5f7b79e8-98f4-4d04-b1b9-6dc740356866 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:32.922875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5f7b79e8-98f4-4d04-b1b9-6dc740356866 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:32.930160 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f7b79e8-98f4-4d04-b1b9-6dc740356866 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:32.930628 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f7b79e8-98f4-4d04-b1b9-6dc740356866 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:32.931417 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f7b79e8-98f4-4d04-b1b9-6dc740356866 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:32.931846 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f7b79e8-98f4-4d04-b1b9-6dc740356866 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:33.119174 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5f7b79e8-98f4-4d04-b1b9-6dc740356866 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:33.135936 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5f7b79e8-98f4-4d04-b1b9-6dc740356866 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1367 microversion: 2.1 time: 0.217636 May 26 19:42:33.136529 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 306/603] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:32 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:33.734311 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8f943f86-a36a-490e-9d6c-921b8ccd6c6f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:33.735678 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8f943f86-a36a-490e-9d6c-921b8ccd6c6f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:33.745514 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f943f86-a36a-490e-9d6c-921b8ccd6c6f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:33.745970 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f943f86-a36a-490e-9d6c-921b8ccd6c6f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:33.747955 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f943f86-a36a-490e-9d6c-921b8ccd6c6f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:33.748193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f943f86-a36a-490e-9d6c-921b8ccd6c6f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:33.832876 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8190e512-8d2b-4953-815e-07c73875186b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:33.833830 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8190e512-8d2b-4953-815e-07c73875186b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:33.840679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8f943f86-a36a-490e-9d6c-921b8ccd6c6f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:33.841598 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8190e512-8d2b-4953-815e-07c73875186b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:33.842305 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8190e512-8d2b-4953-815e-07c73875186b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:33.843196 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8190e512-8d2b-4953-815e-07c73875186b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:33.843703 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8190e512-8d2b-4953-815e-07c73875186b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:33.851551 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8f943f86-a36a-490e-9d6c-921b8ccd6c6f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1289 microversion: 2.1 time: 0.120924 May 26 19:42:33.855936 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 298/604] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:33 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:34.013423 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8190e512-8d2b-4953-815e-07c73875186b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:34.022129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8190e512-8d2b-4953-815e-07c73875186b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.194146 May 26 19:42:34.022722 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 307/605] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:33 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:34.153622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0a57cb35-ba3c-4f93-8dcd-0e041f3fe489 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:34.154159 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0a57cb35-ba3c-4f93-8dcd-0e041f3fe489 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:34.161259 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0a57cb35-ba3c-4f93-8dcd-0e041f3fe489 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:34.161722 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0a57cb35-ba3c-4f93-8dcd-0e041f3fe489 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:34.162472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0a57cb35-ba3c-4f93-8dcd-0e041f3fe489 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:34.162919 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0a57cb35-ba3c-4f93-8dcd-0e041f3fe489 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:34.421881 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0a57cb35-ba3c-4f93-8dcd-0e041f3fe489 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:34.431004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0a57cb35-ba3c-4f93-8dcd-0e041f3fe489 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1367 microversion: 2.1 time: 0.281292 May 26 19:42:34.431897 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 299/606] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:34 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:34.527351 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-2a42e13a-d058-4ad5-ad22-8d7214b40d5d req-b099e5e7-9810-4405-a3e9-1c3e8498524c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3557b49-893e-4c9b-bc84-324e8db5117e", "tag": "65821ee3-a623-4001-a22a-7ee3a346e6ea"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:34.535982 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-2a42e13a-d058-4ad5-ad22-8d7214b40d5d req-b099e5e7-9810-4405-a3e9-1c3e8498524c service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:34.536424 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-2a42e13a-d058-4ad5-ad22-8d7214b40d5d req-b099e5e7-9810-4405-a3e9-1c3e8498524c service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:34.550943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-2a42e13a-d058-4ad5-ad22-8d7214b40d5d req-b099e5e7-9810-4405-a3e9-1c3e8498524c service nova] Creating event network-changed:65821ee3-a623-4001-a22a-7ee3a346e6ea for instance d3557b49-893e-4c9b-bc84-324e8db5117e on hv-cinder-82549 May 26 19:42:34.553406 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-2a42e13a-d058-4ad5-ad22-8d7214b40d5d req-b099e5e7-9810-4405-a3e9-1c3e8498524c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030143 May 26 19:42:34.554043 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 308/607] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:34.874752 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e3810137-ab1f-4221-8343-9496e254b194 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:34.875539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e3810137-ab1f-4221-8343-9496e254b194 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:34.881909 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e3810137-ab1f-4221-8343-9496e254b194 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:34.882364 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e3810137-ab1f-4221-8343-9496e254b194 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:34.887997 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e3810137-ab1f-4221-8343-9496e254b194 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:34.887997 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e3810137-ab1f-4221-8343-9496e254b194 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:35.004800 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e3810137-ab1f-4221-8343-9496e254b194 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:35.012323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e3810137-ab1f-4221-8343-9496e254b194 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1297 microversion: 2.1 time: 0.142352 May 26 19:42:35.012899 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 300/608] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:34 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1297 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:35.047424 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-72ad5cd9-b70b-4524-92a4-8e0ba8e99fa8 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:35.048225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-72ad5cd9-b70b-4524-92a4-8e0ba8e99fa8 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:35.055796 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-72ad5cd9-b70b-4524-92a4-8e0ba8e99fa8 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:35.056377 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-72ad5cd9-b70b-4524-92a4-8e0ba8e99fa8 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:35.057201 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-72ad5cd9-b70b-4524-92a4-8e0ba8e99fa8 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:35.057880 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-72ad5cd9-b70b-4524-92a4-8e0ba8e99fa8 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:35.202520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-72ad5cd9-b70b-4524-92a4-8e0ba8e99fa8 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:35.210953 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-72ad5cd9-b70b-4524-92a4-8e0ba8e99fa8 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.173068 May 26 19:42:35.215360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 309/609] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:35 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:35.448758 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a06d78a6-fb14-44d9-83d1-5fce74204ffd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:35.449484 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a06d78a6-fb14-44d9-83d1-5fce74204ffd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:35.455615 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a06d78a6-fb14-44d9-83d1-5fce74204ffd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:35.456077 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a06d78a6-fb14-44d9-83d1-5fce74204ffd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:35.456818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a06d78a6-fb14-44d9-83d1-5fce74204ffd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:35.457244 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a06d78a6-fb14-44d9-83d1-5fce74204ffd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:35.750596 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a06d78a6-fb14-44d9-83d1-5fce74204ffd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:35.759101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a06d78a6-fb14-44d9-83d1-5fce74204ffd tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1367 microversion: 2.1 time: 0.314198 May 26 19:42:35.759684 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 301/610] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:35 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:36.029792 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-58df37f2-0ec5-49e8-8f41-15c929d6e8d0 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:36.030500 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-58df37f2-0ec5-49e8-8f41-15c929d6e8d0 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:36.038191 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58df37f2-0ec5-49e8-8f41-15c929d6e8d0 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:36.039315 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58df37f2-0ec5-49e8-8f41-15c929d6e8d0 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:36.040256 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58df37f2-0ec5-49e8-8f41-15c929d6e8d0 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:36.040755 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58df37f2-0ec5-49e8-8f41-15c929d6e8d0 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:36.183438 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-58df37f2-0ec5-49e8-8f41-15c929d6e8d0 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:36.191004 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-58df37f2-0ec5-49e8-8f41-15c929d6e8d0 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1363 microversion: 2.1 time: 0.165158 May 26 19:42:36.191592 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 310/611] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:36 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:36.228236 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a5ba5caf-66f8-48a9-ad48-6cef34e67838 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:36.228840 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a5ba5caf-66f8-48a9-ad48-6cef34e67838 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:36.235699 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5ba5caf-66f8-48a9-ad48-6cef34e67838 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:36.236141 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5ba5caf-66f8-48a9-ad48-6cef34e67838 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:36.236901 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5ba5caf-66f8-48a9-ad48-6cef34e67838 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:36.237333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a5ba5caf-66f8-48a9-ad48-6cef34e67838 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:36.373184 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a5ba5caf-66f8-48a9-ad48-6cef34e67838 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:36.380767 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a5ba5caf-66f8-48a9-ad48-6cef34e67838 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.156441 May 26 19:42:36.381439 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 302/612] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:36 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:36.775536 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b4ff1f25-5033-4042-a734-b5f8589e083c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:36.776127 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b4ff1f25-5033-4042-a734-b5f8589e083c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:36.782112 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b4ff1f25-5033-4042-a734-b5f8589e083c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:36.782565 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b4ff1f25-5033-4042-a734-b5f8589e083c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:36.783348 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b4ff1f25-5033-4042-a734-b5f8589e083c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:36.783790 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b4ff1f25-5033-4042-a734-b5f8589e083c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:36.787806 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:36.925632 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b4ff1f25-5033-4042-a734-b5f8589e083c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:36.933862 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b4ff1f25-5033-4042-a734-b5f8589e083c tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1367 microversion: 2.1 time: 0.162183 May 26 19:42:36.938279 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 311/613] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:36 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:37.190663 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-aa5c701e-45ac-4d8f-ad6f-77f03aca1492 req-ce8986e1-3f3d-4b23-8f8a-6f82a4dc2404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae90233-1398-44cd-9ac0-9d660d9b6e64", "tag": "dd065cbe-f746-42d0-9f46-d21f31e26426"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:37.195986 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:37.210404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1e89891e-5ce0-45f3-b705-a01a582d5b80 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:37.211616 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1e89891e-5ce0-45f3-b705-a01a582d5b80 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:37.216965 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-aa5c701e-45ac-4d8f-ad6f-77f03aca1492 req-ce8986e1-3f3d-4b23-8f8a-6f82a4dc2404 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:37.217925 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-aa5c701e-45ac-4d8f-ad6f-77f03aca1492 req-ce8986e1-3f3d-4b23-8f8a-6f82a4dc2404 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:37.225808 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1e89891e-5ce0-45f3-b705-a01a582d5b80 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:37.227159 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1e89891e-5ce0-45f3-b705-a01a582d5b80 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:37.228220 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1e89891e-5ce0-45f3-b705-a01a582d5b80 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:37.230501 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1e89891e-5ce0-45f3-b705-a01a582d5b80 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:37.250769 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-aa5c701e-45ac-4d8f-ad6f-77f03aca1492 req-ce8986e1-3f3d-4b23-8f8a-6f82a4dc2404 service nova] Creating event network-changed:dd065cbe-f746-42d0-9f46-d21f31e26426 for instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 on hv-cinder-82549 May 26 19:42:37.256932 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-aa5c701e-45ac-4d8f-ad6f-77f03aca1492 req-ce8986e1-3f3d-4b23-8f8a-6f82a4dc2404 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074526 May 26 19:42:37.259587 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 303/614] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:37.394582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1e89891e-5ce0-45f3-b705-a01a582d5b80 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:37.400456 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-be2a6216-2bb8-43bd-a1c4-989851f361be tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:37.401379 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-be2a6216-2bb8-43bd-a1c4-989851f361be tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:37.404817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1e89891e-5ce0-45f3-b705-a01a582d5b80 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1363 microversion: 2.1 time: 0.197683 May 26 19:42:37.409059 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-be2a6216-2bb8-43bd-a1c4-989851f361be tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:37.409588 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-be2a6216-2bb8-43bd-a1c4-989851f361be tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:37.410438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-be2a6216-2bb8-43bd-a1c4-989851f361be tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:37.410978 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-be2a6216-2bb8-43bd-a1c4-989851f361be tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:37.412506 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 312/615] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:37 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:37.607836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-be2a6216-2bb8-43bd-a1c4-989851f361be tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:37.615949 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-be2a6216-2bb8-43bd-a1c4-989851f361be tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.222115 May 26 19:42:37.616716 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 304/616] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:37 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:42:37.955248 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6b262016-9b71-4935-aa86-88cf5897e028 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:37.955895 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6b262016-9b71-4935-aa86-88cf5897e028 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:37.961892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6b262016-9b71-4935-aa86-88cf5897e028 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:37.962343 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6b262016-9b71-4935-aa86-88cf5897e028 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:37.963124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6b262016-9b71-4935-aa86-88cf5897e028 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:37.963561 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6b262016-9b71-4935-aa86-88cf5897e028 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:38.089308 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6b262016-9b71-4935-aa86-88cf5897e028 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:38.096604 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6b262016-9b71-4935-aa86-88cf5897e028 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1367 microversion: 2.1 time: 0.147852 May 26 19:42:38.097170 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 313/617] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:37 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:38.419904 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1d78df6c-fca0-40be-b031-8e2b025607a4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:38.420513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1d78df6c-fca0-40be-b031-8e2b025607a4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:38.427816 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d78df6c-fca0-40be-b031-8e2b025607a4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:38.428297 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d78df6c-fca0-40be-b031-8e2b025607a4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:38.429095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d78df6c-fca0-40be-b031-8e2b025607a4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:38.429587 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d78df6c-fca0-40be-b031-8e2b025607a4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:38.558728 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1d78df6c-fca0-40be-b031-8e2b025607a4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:38.566737 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1d78df6c-fca0-40be-b031-8e2b025607a4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1363 microversion: 2.1 time: 0.150858 May 26 19:42:38.567346 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 305/618] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:38 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:38.633599 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-770a372d-51f9-4deb-9934-21ef4387f8bb tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:38.634136 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-770a372d-51f9-4deb-9934-21ef4387f8bb tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:38.640611 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-770a372d-51f9-4deb-9934-21ef4387f8bb tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:38.641059 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-770a372d-51f9-4deb-9934-21ef4387f8bb tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:38.641818 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-770a372d-51f9-4deb-9934-21ef4387f8bb tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:38.642281 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-770a372d-51f9-4deb-9934-21ef4387f8bb tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:38.778808 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-770a372d-51f9-4deb-9934-21ef4387f8bb tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:38.786871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-770a372d-51f9-4deb-9934-21ef4387f8bb tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.157267 May 26 19:42:38.787484 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 314/619] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:38 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:39.113926 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-eaec9a42-fb86-4ae5-96a5-506529c49413 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:39.114529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-eaec9a42-fb86-4ae5-96a5-506529c49413 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:39.120990 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eaec9a42-fb86-4ae5-96a5-506529c49413 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:39.121473 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eaec9a42-fb86-4ae5-96a5-506529c49413 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:39.122271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eaec9a42-fb86-4ae5-96a5-506529c49413 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:39.122706 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eaec9a42-fb86-4ae5-96a5-506529c49413 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:39.262396 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-eaec9a42-fb86-4ae5-96a5-506529c49413 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:39.270348 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-eaec9a42-fb86-4ae5-96a5-506529c49413 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1367 microversion: 2.1 time: 0.160813 May 26 19:42:39.270919 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 306/620] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:39 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:39.422854 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-54ca09d3-160a-45af-8308-8e273b3d054f req-e5ae0c42-86fe-4b48-8f1e-7920fbf28d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b3cb81-bd61-4e0e-bb00-6c40deb52f1b", "name": "network-vif-plugged", "status": "completed", "tag": "c5e1749f-1285-4e41-9fd3-c9a4834b4493"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:39.431161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-54ca09d3-160a-45af-8308-8e273b3d054f req-e5ae0c42-86fe-4b48-8f1e-7920fbf28d7b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:39.431604 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-54ca09d3-160a-45af-8308-8e273b3d054f req-e5ae0c42-86fe-4b48-8f1e-7920fbf28d7b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:39.442190 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-54ca09d3-160a-45af-8308-8e273b3d054f req-e5ae0c42-86fe-4b48-8f1e-7920fbf28d7b service nova] Creating event network-vif-plugged:c5e1749f-1285-4e41-9fd3-c9a4834b4493 for instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b on hv-cinder-82549 May 26 19:42:39.446984 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-54ca09d3-160a-45af-8308-8e273b3d054f req-e5ae0c42-86fe-4b48-8f1e-7920fbf28d7b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083828 May 26 19:42:39.447576 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 315/621] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:39.584044 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-71921dbd-435c-4f30-8ca5-a6af055323cf tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:39.584644 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-71921dbd-435c-4f30-8ca5-a6af055323cf tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:39.591279 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-71921dbd-435c-4f30-8ca5-a6af055323cf tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:39.591723 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-71921dbd-435c-4f30-8ca5-a6af055323cf tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:39.592474 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-71921dbd-435c-4f30-8ca5-a6af055323cf tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:39.592932 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-71921dbd-435c-4f30-8ca5-a6af055323cf tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:39.722321 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-71921dbd-435c-4f30-8ca5-a6af055323cf tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:39.729931 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-71921dbd-435c-4f30-8ca5-a6af055323cf tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1363 microversion: 2.1 time: 0.150366 May 26 19:42:39.730498 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 307/622] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:39 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:39.806184 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b86c612f-87cf-401b-8378-8d2c1657eb42 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:39.806920 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b86c612f-87cf-401b-8378-8d2c1657eb42 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:39.813410 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b86c612f-87cf-401b-8378-8d2c1657eb42 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:39.814918 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b86c612f-87cf-401b-8378-8d2c1657eb42 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:39.814918 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b86c612f-87cf-401b-8378-8d2c1657eb42 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:39.815159 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b86c612f-87cf-401b-8378-8d2c1657eb42 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:39.946871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b86c612f-87cf-401b-8378-8d2c1657eb42 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:39.954438 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b86c612f-87cf-401b-8378-8d2c1657eb42 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.153370 May 26 19:42:39.955559 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 316/623] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:39 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:40.288073 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9b19cbf9-cfe4-4809-92a2-0c4042f9f60e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:40.288676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9b19cbf9-cfe4-4809-92a2-0c4042f9f60e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:40.294791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9b19cbf9-cfe4-4809-92a2-0c4042f9f60e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:40.295264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9b19cbf9-cfe4-4809-92a2-0c4042f9f60e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:40.296009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9b19cbf9-cfe4-4809-92a2-0c4042f9f60e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:40.296438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9b19cbf9-cfe4-4809-92a2-0c4042f9f60e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:40.426818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9b19cbf9-cfe4-4809-92a2-0c4042f9f60e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:40.434547 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9b19cbf9-cfe4-4809-92a2-0c4042f9f60e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1367 microversion: 2.1 time: 0.150314 May 26 19:42:40.435143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 308/624] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:40 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:40.747414 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-bd863f86-e891-4106-89eb-1edacaed9770 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:40.748013 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-bd863f86-e891-4106-89eb-1edacaed9770 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:40.754593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bd863f86-e891-4106-89eb-1edacaed9770 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:40.755104 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bd863f86-e891-4106-89eb-1edacaed9770 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:40.755862 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bd863f86-e891-4106-89eb-1edacaed9770 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:40.756292 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bd863f86-e891-4106-89eb-1edacaed9770 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:40.884676 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-bd863f86-e891-4106-89eb-1edacaed9770 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:40.892169 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-bd863f86-e891-4106-89eb-1edacaed9770 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1363 microversion: 2.1 time: 0.148637 May 26 19:42:40.893126 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 317/625] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:40 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:40.971954 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4bb4c379-3540-4080-98b9-5aacd5ccee28 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:40.972559 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4bb4c379-3540-4080-98b9-5aacd5ccee28 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:40.976076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:40.979676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4bb4c379-3540-4080-98b9-5aacd5ccee28 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:40.980124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4bb4c379-3540-4080-98b9-5aacd5ccee28 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:40.980879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4bb4c379-3540-4080-98b9-5aacd5ccee28 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:40.981307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4bb4c379-3540-4080-98b9-5aacd5ccee28 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:41.123868 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4bb4c379-3540-4080-98b9-5aacd5ccee28 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:41.131253 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4bb4c379-3540-4080-98b9-5aacd5ccee28 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.163373 May 26 19:42:41.131820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 309/626] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:40 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:41.452155 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-268bb8fb-cfa1-4a79-887b-80987b1d47ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:41.453124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-268bb8fb-cfa1-4a79-887b-80987b1d47ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:41.455182 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=4 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:41.461108 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-268bb8fb-cfa1-4a79-887b-80987b1d47ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:41.461571 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-268bb8fb-cfa1-4a79-887b-80987b1d47ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:41.462354 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-268bb8fb-cfa1-4a79-887b-80987b1d47ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:41.462787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-268bb8fb-cfa1-4a79-887b-80987b1d47ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:41.594677 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-268bb8fb-cfa1-4a79-887b-80987b1d47ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:41.606068 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-268bb8fb-cfa1-4a79-887b-80987b1d47ea tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1367 microversion: 2.1 time: 0.157747 May 26 19:42:41.606670 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 318/627] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:41 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:41.909834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-28f86902-fcc0-4d08-95fc-1d9f6b199a46 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:41.910443 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-28f86902-fcc0-4d08-95fc-1d9f6b199a46 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:41.912315 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=16 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:41.917075 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-28f86902-fcc0-4d08-95fc-1d9f6b199a46 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:41.917527 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-28f86902-fcc0-4d08-95fc-1d9f6b199a46 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:41.918284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-28f86902-fcc0-4d08-95fc-1d9f6b199a46 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:41.918745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-28f86902-fcc0-4d08-95fc-1d9f6b199a46 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:42.047197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-28f86902-fcc0-4d08-95fc-1d9f6b199a46 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:42.054587 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-28f86902-fcc0-4d08-95fc-1d9f6b199a46 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1363 microversion: 2.1 time: 0.149354 May 26 19:42:42.055198 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 310/628] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:41 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:42.148455 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c1b23852-fca0-4d96-ad2f-ff140db1c8bc tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:42.149054 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c1b23852-fca0-4d96-ad2f-ff140db1c8bc tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:42.155567 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c1b23852-fca0-4d96-ad2f-ff140db1c8bc tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:42.156010 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c1b23852-fca0-4d96-ad2f-ff140db1c8bc tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:42.156754 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c1b23852-fca0-4d96-ad2f-ff140db1c8bc tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:42.157183 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c1b23852-fca0-4d96-ad2f-ff140db1c8bc tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:42.289607 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c1b23852-fca0-4d96-ad2f-ff140db1c8bc tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:42.297176 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c1b23852-fca0-4d96-ad2f-ff140db1c8bc tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.152562 May 26 19:42:42.297737 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 319/629] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:42 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:42.623895 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9f5b6a4e-7899-4849-95b9-df246d037d35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:42.624425 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9f5b6a4e-7899-4849-95b9-df246d037d35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:42.630347 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f5b6a4e-7899-4849-95b9-df246d037d35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:42.630790 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f5b6a4e-7899-4849-95b9-df246d037d35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:42.631571 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f5b6a4e-7899-4849-95b9-df246d037d35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:42.632014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f5b6a4e-7899-4849-95b9-df246d037d35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:42.757825 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9f5b6a4e-7899-4849-95b9-df246d037d35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:42.765311 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9f5b6a4e-7899-4849-95b9-df246d037d35 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1557 microversion: 2.1 time: 0.145352 May 26 19:42:42.765957 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 311/630] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:42 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:42.781507 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-273f31b0-fe9b-4b4d-a09a-16b029eea2c3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:42.781994 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-273f31b0-fe9b-4b4d-a09a-16b029eea2c3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:42.784352 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=20 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:42.789047 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-273f31b0-fe9b-4b4d-a09a-16b029eea2c3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:42.789489 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-273f31b0-fe9b-4b4d-a09a-16b029eea2c3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:42.790232 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-273f31b0-fe9b-4b4d-a09a-16b029eea2c3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:42.790662 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-273f31b0-fe9b-4b4d-a09a-16b029eea2c3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:42.865867 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-273f31b0-fe9b-4b4d-a09a-16b029eea2c3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088143 May 26 19:42:42.866466 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 320/631] 10.222.0.72 () {58 vars in 1274 bytes} [Thu May 26 19:42:42 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:43.071493 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-abec3bb3-ef99-431b-a232-5b3bdfb80166 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:43.072252 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-abec3bb3-ef99-431b-a232-5b3bdfb80166 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:43.078588 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-abec3bb3-ef99-431b-a232-5b3bdfb80166 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:43.079069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-abec3bb3-ef99-431b-a232-5b3bdfb80166 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:43.079825 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-abec3bb3-ef99-431b-a232-5b3bdfb80166 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:43.080255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-abec3bb3-ef99-431b-a232-5b3bdfb80166 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:43.214158 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-abec3bb3-ef99-431b-a232-5b3bdfb80166 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:43.222190 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-abec3bb3-ef99-431b-a232-5b3bdfb80166 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1363 microversion: 2.1 time: 0.154272 May 26 19:42:43.222747 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 312/632] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:43 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:43.314575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d6bb6794-bdc3-46df-a9bf-9a28cb2db416 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:43.316504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d6bb6794-bdc3-46df-a9bf-9a28cb2db416 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:43.323485 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d6bb6794-bdc3-46df-a9bf-9a28cb2db416 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:43.328034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d6bb6794-bdc3-46df-a9bf-9a28cb2db416 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:43.328034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d6bb6794-bdc3-46df-a9bf-9a28cb2db416 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:43.328034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d6bb6794-bdc3-46df-a9bf-9a28cb2db416 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:43.414826 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-250008e4-8bbc-435c-8687-137d697b7f1d req-f3d309ee-d4f1-4c5b-ba48-410f2eca51bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae90233-1398-44cd-9ac0-9d660d9b6e64", "name": "network-vif-plugged", "status": "completed", "tag": "dd065cbe-f746-42d0-9f46-d21f31e26426"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:43.424736 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-250008e4-8bbc-435c-8687-137d697b7f1d req-f3d309ee-d4f1-4c5b-ba48-410f2eca51bb service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:43.425547 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-250008e4-8bbc-435c-8687-137d697b7f1d req-f3d309ee-d4f1-4c5b-ba48-410f2eca51bb service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:43.430255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=100 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:43.437647 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-250008e4-8bbc-435c-8687-137d697b7f1d req-f3d309ee-d4f1-4c5b-ba48-410f2eca51bb service nova] Creating event network-vif-plugged:dd065cbe-f746-42d0-9f46-d21f31e26426 for instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 on hv-cinder-82549 May 26 19:42:43.443142 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-250008e4-8bbc-435c-8687-137d697b7f1d req-f3d309ee-d4f1-4c5b-ba48-410f2eca51bb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032319 May 26 19:42:43.443878 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 313/633] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:42:43.532912 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d6bb6794-bdc3-46df-a9bf-9a28cb2db416 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:43.541087 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d6bb6794-bdc3-46df-a9bf-9a28cb2db416 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.230232 May 26 19:42:43.541677 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 321/634] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:43 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:44.203084 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-3938d411-f294-42e8-bc0a-97cb2344ceb7 req-03cfecce-0d26-4659-b285-29f3b02007c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b3cb81-bd61-4e0e-bb00-6c40deb52f1b", "tag": "c5e1749f-1285-4e41-9fd3-c9a4834b4493"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:44.211521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-3938d411-f294-42e8-bc0a-97cb2344ceb7 req-03cfecce-0d26-4659-b285-29f3b02007c6 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:44.211961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-3938d411-f294-42e8-bc0a-97cb2344ceb7 req-03cfecce-0d26-4659-b285-29f3b02007c6 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:44.223902 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-3938d411-f294-42e8-bc0a-97cb2344ceb7 req-03cfecce-0d26-4659-b285-29f3b02007c6 service nova] Creating event network-changed:c5e1749f-1285-4e41-9fd3-c9a4834b4493 for instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b on hv-cinder-82549 May 26 19:42:44.228684 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-3938d411-f294-42e8-bc0a-97cb2344ceb7 req-03cfecce-0d26-4659-b285-29f3b02007c6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093688 May 26 19:42:44.229312 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 314/635] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:44.239651 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-060b2b34-e05e-46b4-a7b8-e35e8fdab3d1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:44.240186 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-060b2b34-e05e-46b4-a7b8-e35e8fdab3d1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:44.246341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-060b2b34-e05e-46b4-a7b8-e35e8fdab3d1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:44.246787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-060b2b34-e05e-46b4-a7b8-e35e8fdab3d1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:44.247578 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-060b2b34-e05e-46b4-a7b8-e35e8fdab3d1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:44.248016 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-060b2b34-e05e-46b4-a7b8-e35e8fdab3d1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:44.376228 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-060b2b34-e05e-46b4-a7b8-e35e8fdab3d1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:44.384008 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-060b2b34-e05e-46b4-a7b8-e35e8fdab3d1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1363 microversion: 2.1 time: 0.148815 May 26 19:42:44.384670 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 322/636] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:44 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:44.558157 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d5f5775a-39b8-4f6e-b011-0845115c5915 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:44.559604 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d5f5775a-39b8-4f6e-b011-0845115c5915 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:44.566407 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d5f5775a-39b8-4f6e-b011-0845115c5915 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:44.566851 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d5f5775a-39b8-4f6e-b011-0845115c5915 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:44.567672 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d5f5775a-39b8-4f6e-b011-0845115c5915 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:44.568109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d5f5775a-39b8-4f6e-b011-0845115c5915 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:44.776074 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d5f5775a-39b8-4f6e-b011-0845115c5915 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:44.783828 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d5f5775a-39b8-4f6e-b011-0845115c5915 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.229719 May 26 19:42:44.784671 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 315/637] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:44 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:45.402268 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3aec9f91-cee4-459f-ad8f-eea0b5e6f0f4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:45.403024 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3aec9f91-cee4-459f-ad8f-eea0b5e6f0f4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:45.409724 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3aec9f91-cee4-459f-ad8f-eea0b5e6f0f4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:45.410263 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3aec9f91-cee4-459f-ad8f-eea0b5e6f0f4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:45.411265 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3aec9f91-cee4-459f-ad8f-eea0b5e6f0f4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:45.411981 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3aec9f91-cee4-459f-ad8f-eea0b5e6f0f4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:45.562656 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3aec9f91-cee4-459f-ad8f-eea0b5e6f0f4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:45.570152 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3aec9f91-cee4-459f-ad8f-eea0b5e6f0f4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1363 microversion: 2.1 time: 0.172719 May 26 19:42:45.570719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 323/638] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:45 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:45.801739 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-73d9d85b-10f4-4d3b-842a-f339b7fb4d8f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:45.802340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-73d9d85b-10f4-4d3b-842a-f339b7fb4d8f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:45.809001 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-73d9d85b-10f4-4d3b-842a-f339b7fb4d8f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:45.809449 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-73d9d85b-10f4-4d3b-842a-f339b7fb4d8f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:45.810206 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-73d9d85b-10f4-4d3b-842a-f339b7fb4d8f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:45.810633 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-73d9d85b-10f4-4d3b-842a-f339b7fb4d8f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:45.944931 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-73d9d85b-10f4-4d3b-842a-f339b7fb4d8f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:45.952490 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-73d9d85b-10f4-4d3b-842a-f339b7fb4d8f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.155190 May 26 19:42:45.953061 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 316/639] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:45 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:46.586508 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-70d6a4eb-5753-4a52-be9c-7719e50d90db tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:46.587138 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-70d6a4eb-5753-4a52-be9c-7719e50d90db tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:46.593628 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-70d6a4eb-5753-4a52-be9c-7719e50d90db tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:46.594070 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-70d6a4eb-5753-4a52-be9c-7719e50d90db tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:46.594813 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-70d6a4eb-5753-4a52-be9c-7719e50d90db tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:46.595268 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-70d6a4eb-5753-4a52-be9c-7719e50d90db tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:46.721164 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-70d6a4eb-5753-4a52-be9c-7719e50d90db tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:46.728524 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-70d6a4eb-5753-4a52-be9c-7719e50d90db tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1549 microversion: 2.1 time: 0.145941 May 26 19:42:46.729083 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 324/640] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:46 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:46.745573 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-74a2639f-fdc3-4ce4-8b98-6108d95eefb3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:46.746060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-74a2639f-fdc3-4ce4-8b98-6108d95eefb3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:46.752039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-74a2639f-fdc3-4ce4-8b98-6108d95eefb3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:46.753253 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-74a2639f-fdc3-4ce4-8b98-6108d95eefb3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:46.754078 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-74a2639f-fdc3-4ce4-8b98-6108d95eefb3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:46.754508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-74a2639f-fdc3-4ce4-8b98-6108d95eefb3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:46.830393 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-74a2639f-fdc3-4ce4-8b98-6108d95eefb3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088765 May 26 19:42:46.831501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 317/641] 10.222.0.72 () {58 vars in 1274 bytes} [Thu May 26 19:42:46 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:46.970126 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-49bad737-d78b-4e76-9227-8b0bea7d68a9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:46.970650 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-49bad737-d78b-4e76-9227-8b0bea7d68a9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:46.977193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-49bad737-d78b-4e76-9227-8b0bea7d68a9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:46.977638 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-49bad737-d78b-4e76-9227-8b0bea7d68a9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:46.978398 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-49bad737-d78b-4e76-9227-8b0bea7d68a9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:46.978832 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-49bad737-d78b-4e76-9227-8b0bea7d68a9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:47.108049 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-49bad737-d78b-4e76-9227-8b0bea7d68a9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:47.115641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-49bad737-d78b-4e76-9227-8b0bea7d68a9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.149456 May 26 19:42:47.116222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 325/642] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:46 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:47.443031 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-8b4d2083-ea45-4dc1-b5aa-85757e140c0a req-6ade3d3a-2a6e-4cc2-b98d-d935eccf323b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3557b49-893e-4c9b-bc84-324e8db5117e", "name": "network-vif-plugged", "status": "completed", "tag": "65821ee3-a623-4001-a22a-7ee3a346e6ea"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:47.452328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-8b4d2083-ea45-4dc1-b5aa-85757e140c0a req-6ade3d3a-2a6e-4cc2-b98d-d935eccf323b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:47.452777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-8b4d2083-ea45-4dc1-b5aa-85757e140c0a req-6ade3d3a-2a6e-4cc2-b98d-d935eccf323b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:47.463974 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-8b4d2083-ea45-4dc1-b5aa-85757e140c0a req-6ade3d3a-2a6e-4cc2-b98d-d935eccf323b service nova] Creating event network-vif-plugged:65821ee3-a623-4001-a22a-7ee3a346e6ea for instance d3557b49-893e-4c9b-bc84-324e8db5117e on hv-cinder-82549 May 26 19:42:47.468770 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-8b4d2083-ea45-4dc1-b5aa-85757e140c0a req-6ade3d3a-2a6e-4cc2-b98d-d935eccf323b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031006 May 26 19:42:47.469427 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 318/643] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:48.133184 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-81076ea0-ef7e-4d02-a868-12054948ac75 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:48.133734 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-81076ea0-ef7e-4d02-a868-12054948ac75 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:48.136868 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-ee5d44df-2bbf-49ef-b5ed-221a2b77c9a5 req-e77c969b-bec1-4cbc-81a0-38607829afb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae90233-1398-44cd-9ac0-9d660d9b6e64", "tag": "dd065cbe-f746-42d0-9f46-d21f31e26426"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:48.140307 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81076ea0-ef7e-4d02-a868-12054948ac75 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:48.140982 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81076ea0-ef7e-4d02-a868-12054948ac75 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:48.141759 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81076ea0-ef7e-4d02-a868-12054948ac75 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:48.142197 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-81076ea0-ef7e-4d02-a868-12054948ac75 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:48.146259 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-ee5d44df-2bbf-49ef-b5ed-221a2b77c9a5 req-e77c969b-bec1-4cbc-81a0-38607829afb6 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:48.146686 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-ee5d44df-2bbf-49ef-b5ed-221a2b77c9a5 req-e77c969b-bec1-4cbc-81a0-38607829afb6 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:48.157506 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-ee5d44df-2bbf-49ef-b5ed-221a2b77c9a5 req-e77c969b-bec1-4cbc-81a0-38607829afb6 service nova] Creating event network-changed:dd065cbe-f746-42d0-9f46-d21f31e26426 for instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 on hv-cinder-82549 May 26 19:42:48.162387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-ee5d44df-2bbf-49ef-b5ed-221a2b77c9a5 req-e77c969b-bec1-4cbc-81a0-38607829afb6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029981 May 26 19:42:48.163013 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 319/644] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:48.284963 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-81076ea0-ef7e-4d02-a868-12054948ac75 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:48.294326 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-81076ea0-ef7e-4d02-a868-12054948ac75 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.165005 May 26 19:42:48.295559 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 326/645] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:48 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:49.312963 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-59980899-55de-4b1e-ba34-838def36148e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:49.313648 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-59980899-55de-4b1e-ba34-838def36148e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:49.320389 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-59980899-55de-4b1e-ba34-838def36148e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:49.320834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-59980899-55de-4b1e-ba34-838def36148e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:49.321580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-59980899-55de-4b1e-ba34-838def36148e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:49.322011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-59980899-55de-4b1e-ba34-838def36148e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:49.454251 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-59980899-55de-4b1e-ba34-838def36148e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:49.463990 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-59980899-55de-4b1e-ba34-838def36148e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1267 microversion: 2.1 time: 0.155500 May 26 19:42:49.469970 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 320/646] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:49 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:50.480839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4fe66197-96e6-4050-ab92-5b8df83f8d9e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:50.481475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4fe66197-96e6-4050-ab92-5b8df83f8d9e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:50.488053 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4fe66197-96e6-4050-ab92-5b8df83f8d9e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:50.488494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4fe66197-96e6-4050-ab92-5b8df83f8d9e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:50.489241 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4fe66197-96e6-4050-ab92-5b8df83f8d9e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:50.489669 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4fe66197-96e6-4050-ab92-5b8df83f8d9e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:50.615626 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4fe66197-96e6-4050-ab92-5b8df83f8d9e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:50.623300 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4fe66197-96e6-4050-ab92-5b8df83f8d9e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1455 microversion: 2.1 time: 0.146243 May 26 19:42:50.623805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 327/647] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:50 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:50.639461 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2cdce372-8e5a-4c58-a7c8-345fc4e04817 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:50.640066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2cdce372-8e5a-4c58-a7c8-345fc4e04817 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:50.647196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2cdce372-8e5a-4c58-a7c8-345fc4e04817 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:50.647639 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2cdce372-8e5a-4c58-a7c8-345fc4e04817 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:50.648386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2cdce372-8e5a-4c58-a7c8-345fc4e04817 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:50.648816 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2cdce372-8e5a-4c58-a7c8-345fc4e04817 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:50.780247 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2cdce372-8e5a-4c58-a7c8-345fc4e04817 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:42:50.788196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2cdce372-8e5a-4c58-a7c8-345fc4e04817 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1455 microversion: 2.1 time: 0.152610 May 26 19:42:50.788755 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 321/648] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:42:50 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:42:52.978369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-0ec30a62-ea2d-46e0-b497-6b9a6ea091bd req-7c3b4ab4-3f5f-403d-bf6b-4f3acf626166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3557b49-893e-4c9b-bc84-324e8db5117e", "tag": "65821ee3-a623-4001-a22a-7ee3a346e6ea"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:42:52.986537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-0ec30a62-ea2d-46e0-b497-6b9a6ea091bd req-7c3b4ab4-3f5f-403d-bf6b-4f3acf626166 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:52.987520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-0ec30a62-ea2d-46e0-b497-6b9a6ea091bd req-7c3b4ab4-3f5f-403d-bf6b-4f3acf626166 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:52.998959 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-0ec30a62-ea2d-46e0-b497-6b9a6ea091bd req-7c3b4ab4-3f5f-403d-bf6b-4f3acf626166 service nova] Creating event network-changed:65821ee3-a623-4001-a22a-7ee3a346e6ea for instance d3557b49-893e-4c9b-bc84-324e8db5117e on hv-cinder-82549 May 26 19:42:53.004642 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-0ec30a62-ea2d-46e0-b497-6b9a6ea091bd req-7c3b4ab4-3f5f-403d-bf6b-4f3acf626166 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029937 May 26 19:42:53.005403 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 328/649] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:42:59.243939 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1a2665d5-8d4d-4de7-970c-fbb9382ff9cc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:42:59.244427 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1a2665d5-8d4d-4de7-970c-fbb9382ff9cc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:42:59.251403 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1a2665d5-8d4d-4de7-970c-fbb9382ff9cc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:59.251842 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1a2665d5-8d4d-4de7-970c-fbb9382ff9cc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:59.253136 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1a2665d5-8d4d-4de7-970c-fbb9382ff9cc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:42:59.253567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1a2665d5-8d4d-4de7-970c-fbb9382ff9cc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:42:59.287364 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1a2665d5-8d4d-4de7-970c-fbb9382ff9cc tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/ips" status: 200 len: 152 microversion: 2.20 time: 0.047628 May 26 19:42:59.287930 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 322/650] 10.222.0.72 () {60 vars in 1288 bytes} [Thu May 26 19:42:59 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:43:02.217762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-fb95910c-da89-464b-926a-10fdc3cdbcd0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:43:02.218374 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-fb95910c-da89-464b-926a-10fdc3cdbcd0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:02.224582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fb95910c-da89-464b-926a-10fdc3cdbcd0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:02.225034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fb95910c-da89-464b-926a-10fdc3cdbcd0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:02.225791 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fb95910c-da89-464b-926a-10fdc3cdbcd0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:02.226222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fb95910c-da89-464b-926a-10fdc3cdbcd0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:02.242227 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=100 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:02.248439 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-fb95910c-da89-464b-926a-10fdc3cdbcd0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lazy-loading 'flavor' on Instance uuid 7d37e4a7-2599-4466-b249-a142cf7770f0 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:02.751119 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-fb95910c-da89-464b-926a-10fdc3cdbcd0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/action" status: 202 len: 0 microversion: 2.20 time: 0.538107 May 26 19:43:02.751748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 329/651] 10.222.0.72 () {62 vars in 1318 bytes} [Thu May 26 19:43:02 2022] POST /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 19:43:02.760420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:02.761095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:02.767611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:02.773753 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:02.773753 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:02.773753 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:02.901796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:02.909795 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:02.911514 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:02.912475 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3514e533-f1c5-46d6-a830-91d69d031cc3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.155986 May 26 19:43:02.913037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 323/652] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:02 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:03.932315 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:03.932998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:03.939443 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:03.940460 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:03.941224 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:03.941658 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:04.071958 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:04.079727 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:04.081342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:04.082485 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-045df040-fd1a-4071-87bf-e03a91c46e8d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.155211 May 26 19:43:04.083059 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 330/653] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:03 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:05.100709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:05.101315 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:05.107774 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:05.108232 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:05.108993 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:05.109432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:05.240016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:05.248163 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:05.249659 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:05.250806 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f1f38a4d-5a2a-4b25-80f6-a87a68bc0a83 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.154112 May 26 19:43:05.251399 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 324/654] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:05 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:06.269207 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:06.269803 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:06.272201 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=51 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:06.276924 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:06.277361 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:06.278106 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:06.278530 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:06.406229 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:06.415003 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:06.416486 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:06.417692 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-52ded7e9-f2f0-4196-be5a-abfb29251fd8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.152342 May 26 19:43:06.418246 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 331/655] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:06 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:43:07.435879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:07.436473 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:07.443471 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:07.445600 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:07.445600 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:07.445600 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:07.573402 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:07.581360 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:07.582912 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:07.584100 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9782a3c2-4964-4e87-9d46-fab695bda511 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.152157 May 26 19:43:07.584662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 325/656] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:07 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:08.602004 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:08.602598 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:08.609089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:08.609531 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:08.610277 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:08.610704 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:08.740682 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:08.749406 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:08.750360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:08.751754 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-88be74f6-ba8a-4612-93bb-7a09450fa52d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.153528 May 26 19:43:08.752885 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 332/657] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:08 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:09.770312 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:09.770915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:09.777421 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:09.777861 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:09.778607 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:09.779152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:09.906586 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:09.915232 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:09.916724 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:09.917866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f17098b7-c089-4422-a8cb-a5e4e58bd9d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.151536 May 26 19:43:09.918419 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 326/658] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:09 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:10.935129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:10.935729 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:10.942638 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:10.943121 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:10.943873 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:10.944323 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:11.073243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:11.081258 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:11.082772 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:11.084047 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ad63217d-f12b-4949-af0a-a871e551ac6c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.152837 May 26 19:43:11.084613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 333/659] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:10 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:12.102372 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:12.102889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:12.104913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=35 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:12.109713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:12.110167 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:12.110952 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:12.111401 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:12.241731 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:12.249811 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:12.251333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:12.253060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ee9d4dec-6e3b-4c92-aff6-50615721be59 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.154839 May 26 19:43:12.253616 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 327/660] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:12 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:13.271761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:13.272393 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:13.278887 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:13.279358 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:13.280122 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:13.280553 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:13.409616 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:13.420951 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:13.422563 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:13.423901 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3c17d487-e954-4c2e-a072-3267fa5a9cd9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.156512 May 26 19:43:13.424553 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 334/661] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:13 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:14.442280 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:14.442895 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:14.449820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:14.450260 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:14.451124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:14.451767 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:14.454303 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=69 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:14.584716 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:14.592462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:14.593954 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:14.595134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-149bed8a-d391-45df-8599-6a3b7fe65a5b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.156889 May 26 19:43:14.595692 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 328/662] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:14 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:15.614372 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:15.615007 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:15.621851 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:15.622296 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:15.623084 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:15.623520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:15.756261 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:15.764083 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:15.765573 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:15.766713 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d0fa2bfe-637b-4275-8a9f-f01a7e1f612f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.156807 May 26 19:43:15.767290 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 335/663] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:15 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:16.784983 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:16.785585 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:16.792129 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:16.792569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:16.793322 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:16.793750 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:16.922429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:16.930427 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:16.931944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:16.933246 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9a3f8338-8665-476d-a2a8-680eccc4cbeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.152128 May 26 19:43:16.933812 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 329/664] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:16 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:17.952543 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:17.953131 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:17.960179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:17.960624 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:17.961372 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:17.961798 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:18.086513 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:18.094267 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:18.095785 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:18.096918 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c1b8b5a0-fbb0-406b-86b8-5807cb29a7d3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.148392 May 26 19:43:18.097460 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 336/665] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:17 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:19.116983 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:19.117570 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:19.124279 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:19.124717 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:19.125462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:19.126032 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:19.251629 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:19.259641 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:19.261148 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:19.262325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-989ea714-1f83-4fc8-b94a-6e20e41792a4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.149856 May 26 19:43:19.262885 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 330/666] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:19 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:20.280852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:20.281455 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:20.287911 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:20.288350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:20.289096 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:20.289520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:20.423659 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:20.432128 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:20.433668 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:20.434823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9589e4ab-26a8-41bc-b0fd-a6870bf60555 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.157929 May 26 19:43:20.435416 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 337/667] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:20 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:21.453103 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:21.453706 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:21.460991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:21.461436 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:21.462189 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:21.462616 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:21.589943 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:21.597767 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:21.599933 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:21.601081 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4f441f29-1026-450b-8526-735774381378 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.152047 May 26 19:43:21.601644 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 331/668] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:21 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:22.620277 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:22.620800 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:22.626854 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:22.627331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:22.628081 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:22.628515 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:22.755147 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:22.762950 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:22.764449 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:22.765590 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4e64c11f-8830-4a61-9c9f-8d8d5fd33d3c tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.150411 May 26 19:43:22.766148 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 338/669] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:22 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:23.782917 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:23.783525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:23.790097 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:23.790545 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:23.791329 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:23.791769 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:23.922478 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:23.930855 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:23.932378 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:23.933541 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fd697919-82cd-4bd2-980a-199a9f60c0a6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1745 microversion: 2.20 time: 0.154625 May 26 19:43:23.934092 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 332/670] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:23 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:25.048146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:25.048789 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:25.054590 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:25.055075 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:25.055821 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:25.056248 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:25.193711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:25.202411 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:25.203969 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:25.205176 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-dfe839a9-5ff6-48d1-b3b2-a708d1b3013d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1745 microversion: 2.20 time: 0.256729 May 26 19:43:25.205678 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 339/671] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:24 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1745 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:25.266121 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8729e09e-c9cc-43dc-a1dc-92c064e0cf6b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:25.266629 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8729e09e-c9cc-43dc-a1dc-92c064e0cf6b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:25.273119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8729e09e-c9cc-43dc-a1dc-92c064e0cf6b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:25.273563 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8729e09e-c9cc-43dc-a1dc-92c064e0cf6b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:25.274316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8729e09e-c9cc-43dc-a1dc-92c064e0cf6b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:25.274750 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8729e09e-c9cc-43dc-a1dc-92c064e0cf6b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:25.296822 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8729e09e-c9cc-43dc-a1dc-92c064e0cf6b tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/ips" status: 200 len: 150 microversion: 2.1 time: 0.034609 May 26 19:43:25.297374 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 333/672] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:43:25 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:43:26.223311 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:26.223913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:26.230859 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:26.231458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:26.232375 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:26.232969 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:26.367544 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:26.375829 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:26.377373 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:26.378512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9a8205f2-ad19-4b39-9431-23ab69e23774 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1745 microversion: 2.20 time: 0.159248 May 26 19:43:26.379155 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 340/673] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:26 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:27.023455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-cf1d4ce0-4e07-49dd-9e9b-03673821493d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59838908-b6f8-4c63-9fea-e829ed914e65"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:43:27.024508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-cf1d4ce0-4e07-49dd-9e9b-03673821493d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:27.030795 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ce0-4e07-49dd-9e9b-03673821493d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:27.031272 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ce0-4e07-49dd-9e9b-03673821493d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:27.032024 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ce0-4e07-49dd-9e9b-03673821493d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:27.032455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cf1d4ce0-4e07-49dd-9e9b-03673821493d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:27.396944 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:27.402783 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:27.419290 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:27.419744 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:27.425949 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:27.426460 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:27.606057 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:27.614712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:27.616792 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:27.622217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f5ce5a6d-a349-41c6-9f2f-910469a269c6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.229239 May 26 19:43:27.623328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 341/674] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:27 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:27.644458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-5e8e1eac-4d67-4ad0-80bf-d617dcf1e3ab req-1c54237d-ba5f-4eef-b46c-f59f73c543ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d37e4a7-2599-4466-b249-a142cf7770f0", "name": "network-vif-plugged", "status": "completed", "tag": "81fa53c7-4d30-4a24-9182-ad976ec89b2b"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:43:27.653710 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-5e8e1eac-4d67-4ad0-80bf-d617dcf1e3ab req-1c54237d-ba5f-4eef-b46c-f59f73c543ed service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:27.663614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-5e8e1eac-4d67-4ad0-80bf-d617dcf1e3ab req-1c54237d-ba5f-4eef-b46c-f59f73c543ed service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:27.665337 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-5e8e1eac-4d67-4ad0-80bf-d617dcf1e3ab req-1c54237d-ba5f-4eef-b46c-f59f73c543ed service nova] Creating event network-vif-plugged:81fa53c7-4d30-4a24-9182-ad976ec89b2b for instance 7d37e4a7-2599-4466-b249-a142cf7770f0 on hv-cinder-82549 May 26 19:43:27.670642 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-5e8e1eac-4d67-4ad0-80bf-d617dcf1e3ab req-1c54237d-ba5f-4eef-b46c-f59f73c543ed service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029928 May 26 19:43:27.671307 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 342/675] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:43:28.006611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-cf1d4ce0-4e07-49dd-9e9b-03673821493d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "POST /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.987346 May 26 19:43:28.008733 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 334/676] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:43:27 2022] POST /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 194 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:43:28.642876 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:28.644213 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:28.654026 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:28.654026 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:28.654451 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:28.654878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:28.830275 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:28.840352 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:28.841935 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:28.843139 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-93fad77a-25fc-494f-835f-be97c1f9cbc7 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.205648 May 26 19:43:28.845426 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 343/677] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:28 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:29.864998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:29.869569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:29.873466 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:29.874135 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:29.875109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:29.875786 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:30.029825 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:30.040449 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:30.042153 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:30.043486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-23ebc4be-9c43-42e5-aa09-8dd560b6cdaa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.183286 May 26 19:43:30.044096 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 335/678] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:29 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:31.061742 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:31.062688 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:31.070515 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:31.071230 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:31.072179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:31.072614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:31.220849 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:31.224326 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:31.229652 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:31.231351 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:31.241401 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1c7498d4-3c79-4a81-8ee6-7358abaa0215 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.174743 May 26 19:43:31.241401 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 344/679] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:31 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:32.251485 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:32.252191 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:32.259967 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:32.260421 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:32.261195 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:32.261634 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:32.442186 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:32.451457 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:32.453030 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:32.454222 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e4d63482-74ee-4d60-92db-6aba3e513b3d tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.206723 May 26 19:43:32.455055 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 336/680] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:32 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:32.542359 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1cfedd71-628f-49d8-b4c2-27a7ddeb3eaa tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:32.542966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1cfedd71-628f-49d8-b4c2-27a7ddeb3eaa tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:32.550149 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1cfedd71-628f-49d8-b4c2-27a7ddeb3eaa tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:32.550811 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1cfedd71-628f-49d8-b4c2-27a7ddeb3eaa tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:32.551795 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1cfedd71-628f-49d8-b4c2-27a7ddeb3eaa tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:32.552395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1cfedd71-628f-49d8-b4c2-27a7ddeb3eaa tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:32.576992 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1cfedd71-628f-49d8-b4c2-27a7ddeb3eaa tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/ips" status: 200 len: 146 microversion: 2.1 time: 0.039722 May 26 19:43:32.582141 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 345/681] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:43:32 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:43:33.472564 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:33.473125 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:33.479700 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:33.480144 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:33.480899 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:33.481331 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:33.614636 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:33.634045 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:33.635570 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:33.636729 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5194e9d7-aceb-4cad-916d-906e4f477d86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.168308 May 26 19:43:33.637320 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 337/682] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:33 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:34.656099 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:34.657286 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:34.664502 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:34.665330 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:34.665845 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:34.666275 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:34.824993 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:34.833920 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:34.836745 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:34.841396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8804549a-e159-4dcb-b076-f4819f688fa5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.189698 May 26 19:43:34.843983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 346/683] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:34 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:35.475611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a49d6ba1-222e-44fc-915d-f2822794203c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eadf2580-5256-4201-9757-090d451d9a15"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:43:35.476827 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a49d6ba1-222e-44fc-915d-f2822794203c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:35.484001 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a49d6ba1-222e-44fc-915d-f2822794203c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:35.484448 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a49d6ba1-222e-44fc-915d-f2822794203c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:35.485451 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a49d6ba1-222e-44fc-915d-f2822794203c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:35.486072 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a49d6ba1-222e-44fc-915d-f2822794203c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:35.871648 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:35.874021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:35.885021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:35.886197 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:35.887571 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:35.888311 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:36.036311 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:36.046267 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:36.048036 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:36.049209 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ae265731-8090-4430-bc54-be2b81d46d09 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.182441 May 26 19:43:36.049762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 347/684] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:35 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:43:36.264892 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a49d6ba1-222e-44fc-915d-f2822794203c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796487 May 26 19:43:36.269988 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 338/685] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:43:35 2022] POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:43:36.752144 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d802ef96-04db-417c-b573-cee69c7bf9a7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:36.752656 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d802ef96-04db-417c-b573-cee69c7bf9a7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:36.755100 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=34 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:36.760049 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d802ef96-04db-417c-b573-cee69c7bf9a7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:36.760514 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d802ef96-04db-417c-b573-cee69c7bf9a7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:36.761275 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d802ef96-04db-417c-b573-cee69c7bf9a7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:36.761708 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d802ef96-04db-417c-b573-cee69c7bf9a7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:36.844271 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-d802ef96-04db-417c-b573-cee69c7bf9a7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'services' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:37.070408 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:37.071143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:37.077387 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:37.077843 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:37.078606 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:37.079076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:37.214961 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:37.222937 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:37.224434 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:37.225618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-818d556c-2cf6-411c-b4c1-c6ef9a4c8948 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.160507 May 26 19:43:37.226185 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 339/686] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:37 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:43:37.511630 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d802ef96-04db-417c-b573-cee69c7bf9a7 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments/59838908-b6f8-4c63-9fea-e829ed914e65" status: 202 len: 0 microversion: 2.1 time: 0.762938 May 26 19:43:37.515550 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 348/687] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:43:36 2022] DELETE /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments/59838908-b6f8-4c63-9fea-e829ed914e65 => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:43:37.522701 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f8d0f749-8f65-4d9e-983a-33543b99bf73 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:37.523868 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f8d0f749-8f65-4d9e-983a-33543b99bf73 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:37.530475 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f8d0f749-8f65-4d9e-983a-33543b99bf73 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:37.532899 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f8d0f749-8f65-4d9e-983a-33543b99bf73 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:37.535967 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f8d0f749-8f65-4d9e-983a-33543b99bf73 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:37.536426 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f8d0f749-8f65-4d9e-983a-33543b99bf73 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:37.572836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f8d0f749-8f65-4d9e-983a-33543b99bf73 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055928 May 26 19:43:37.574133 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 340/688] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:43:37 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:43:38.244757 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:38.245363 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:38.252277 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:38.252723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:38.253474 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:38.253902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:38.383759 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:38.391585 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:38.393118 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:38.394260 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e23067bd-d85a-4c6b-b22d-6d6e5bf05ce2 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1740 microversion: 2.20 time: 0.154285 May 26 19:43:38.394814 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 349/689] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:38 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:38.585436 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-656272c7-e879-41ff-859f-4352e492f477 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:38.586355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-656272c7-e879-41ff-859f-4352e492f477 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:38.592944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-656272c7-e879-41ff-859f-4352e492f477 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:38.593389 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-656272c7-e879-41ff-859f-4352e492f477 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:38.594222 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-656272c7-e879-41ff-859f-4352e492f477 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:38.594657 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-656272c7-e879-41ff-859f-4352e492f477 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:38.623531 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-656272c7-e879-41ff-859f-4352e492f477 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042686 May 26 19:43:38.624093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 341/690] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:43:38 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:43:39.412574 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:39.413176 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:39.419608 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:39.420075 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:39.420825 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:39.421253 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:39.556532 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:39.564696 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:39.566180 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:39.567342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2488d07c-8c9a-45d3-b118-ea50c03b5e13 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1722 microversion: 2.20 time: 0.158762 May 26 19:43:39.567905 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 350/691] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:39 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:39.635736 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2c4b0119-1d60-4e47-b48d-a5200f70f96d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:39.636696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2c4b0119-1d60-4e47-b48d-a5200f70f96d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:39.643256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2c4b0119-1d60-4e47-b48d-a5200f70f96d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:39.643696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2c4b0119-1d60-4e47-b48d-a5200f70f96d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:39.644458 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2c4b0119-1d60-4e47-b48d-a5200f70f96d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:39.649668 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2c4b0119-1d60-4e47-b48d-a5200f70f96d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:39.658879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:39.677029 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2c4b0119-1d60-4e47-b48d-a5200f70f96d tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 May 26 19:43:39.677588 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 342/692] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:43:39 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:43:40.585462 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:40.586066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:40.593074 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:40.593522 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:40.594279 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:40.594712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:40.688994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d48f0d10-e46c-4818-8068-b30a5824b2d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:40.690016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d48f0d10-e46c-4818-8068-b30a5824b2d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:40.698127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d48f0d10-e46c-4818-8068-b30a5824b2d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:40.698671 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d48f0d10-e46c-4818-8068-b30a5824b2d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:40.699552 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d48f0d10-e46c-4818-8068-b30a5824b2d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:40.700082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d48f0d10-e46c-4818-8068-b30a5824b2d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:40.727420 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:40.731473 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d48f0d10-e46c-4818-8068-b30a5824b2d8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046234 May 26 19:43:40.732084 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 343/693] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:43:40 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:43:40.735304 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:40.736886 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:40.737982 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0d0f9172-f7b9-46f1-961d-cdd99fcb01cd tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1722 microversion: 2.20 time: 0.156493 May 26 19:43:40.738535 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 351/694] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:40 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:41.743197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8f69bcaa-1948-4a40-8eb4-0254031c3378 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:41.744383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8f69bcaa-1948-4a40-8eb4-0254031c3378 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:41.751260 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f69bcaa-1948-4a40-8eb4-0254031c3378 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:41.751713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f69bcaa-1948-4a40-8eb4-0254031c3378 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:41.752485 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f69bcaa-1948-4a40-8eb4-0254031c3378 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:41.752925 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f69bcaa-1948-4a40-8eb4-0254031c3378 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:41.756119 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:41.756722 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:41.763072 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:41.763519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:41.764269 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:41.764693 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:41.786528 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8f69bcaa-1948-4a40-8eb4-0254031c3378 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047388 May 26 19:43:41.787129 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 344/695] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:43:41 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:43:41.898025 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:41.906034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:41.907549 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:41.908727 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5286ee21-7d7d-45a1-b4c5-6190faa3523e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1722 microversion: 2.20 time: 0.156422 May 26 19:43:41.909284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 352/696] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:41 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:43:42.798713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d8999e07-3567-472e-808f-5487a70d3a45 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:42.799669 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d8999e07-3567-472e-808f-5487a70d3a45 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:42.802070 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=36 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:42.807418 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8999e07-3567-472e-808f-5487a70d3a45 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:42.807867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8999e07-3567-472e-808f-5487a70d3a45 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:42.808627 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8999e07-3567-472e-808f-5487a70d3a45 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:42.809067 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8999e07-3567-472e-808f-5487a70d3a45 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:42.838023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d8999e07-3567-472e-808f-5487a70d3a45 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043162 May 26 19:43:42.838663 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 345/697] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:43:42 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:43:42.927234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:42.927767 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:42.934854 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:42.935331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:42.936084 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:42.936516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:43.061827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:43.069678 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:43.071238 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:43.072379 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-93f971a8-54ec-4408-a373-a41a587c6efa tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1665 microversion: 2.20 time: 0.149199 May 26 19:43:43.072934 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 353/698] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:42 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:43.089860 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-34ada6ae-f007-4d11-b695-487ac6b29c07 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "967a132d-6180-4bc0-95c3-2d98dcd35f77"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:43:43.090950 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-34ada6ae-f007-4d11-b695-487ac6b29c07 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:43.096843 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34ada6ae-f007-4d11-b695-487ac6b29c07 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:43.097339 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34ada6ae-f007-4d11-b695-487ac6b29c07 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:43.098102 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34ada6ae-f007-4d11-b695-487ac6b29c07 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:43.098546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-34ada6ae-f007-4d11-b695-487ac6b29c07 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:43.624001 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-c2e06e74-922e-4d74-be69-7ffe20b6f362 req-a682ae7f-9cc0-49f1-9662-e246d60c34f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d37e4a7-2599-4466-b249-a142cf7770f0", "name": "network-vif-unplugged", "status": "completed", "tag": "81fa53c7-4d30-4a24-9182-ad976ec89b2b"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:43:43.632049 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-c2e06e74-922e-4d74-be69-7ffe20b6f362 req-a682ae7f-9cc0-49f1-9662-e246d60c34f0 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:43.632520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-c2e06e74-922e-4d74-be69-7ffe20b6f362 req-a682ae7f-9cc0-49f1-9662-e246d60c34f0 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:43.642995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.compute.server_external_events [req-c2e06e74-922e-4d74-be69-7ffe20b6f362 req-a682ae7f-9cc0-49f1-9662-e246d60c34f0 service nova] Unable to find a host for instance 7d37e4a7-2599-4466-b249-a142cf7770f0. Dropping event network-vif-unplugged {{(pid=124876) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 19:43:43.643845 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-c2e06e74-922e-4d74-be69-7ffe20b6f362 req-a682ae7f-9cc0-49f1-9662-e246d60c34f0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.023853 May 26 19:43:43.644404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 354/699] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 25 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 26 19:43:43.850380 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3fa74f79-7667-4faa-8939-0f6152f7c968 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:43.851614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3fa74f79-7667-4faa-8939-0f6152f7c968 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:43.858879 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3fa74f79-7667-4faa-8939-0f6152f7c968 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:43.859340 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3fa74f79-7667-4faa-8939-0f6152f7c968 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:43.860171 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3fa74f79-7667-4faa-8939-0f6152f7c968 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:43.860658 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3fa74f79-7667-4faa-8939-0f6152f7c968 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:43.891862 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3fa74f79-7667-4faa-8939-0f6152f7c968 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046075 May 26 19:43:43.892413 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 355/700] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:43:43 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:43:44.075834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-34ada6ae-f007-4d11-b695-487ac6b29c07 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.989987 May 26 19:43:44.076460 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 346/701] 10.222.0.72 () {62 vars in 1363 bytes} [Thu May 26 19:43:43 2022] POST /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/os-volume_attachments => generated 188 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 19:43:44.190573 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8b04fe82-e8e6-4e12-963d-3bc6ddcff6c8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:44.191116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8b04fe82-e8e6-4e12-963d-3bc6ddcff6c8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:44.197696 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b04fe82-e8e6-4e12-963d-3bc6ddcff6c8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:44.198145 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b04fe82-e8e6-4e12-963d-3bc6ddcff6c8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:44.198920 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b04fe82-e8e6-4e12-963d-3bc6ddcff6c8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:44.199373 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b04fe82-e8e6-4e12-963d-3bc6ddcff6c8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:44.840602 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2747db2a-55cf-4425-9b51-9187c613a569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:43:44.847769 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2747db2a-55cf-4425-9b51-9187c613a569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:44.848224 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2747db2a-55cf-4425-9b51-9187c613a569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:44.894025 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8b04fe82-e8e6-4e12-963d-3bc6ddcff6c8 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/os-volume_attachments/967a132d-6180-4bc0-95c3-2d98dcd35f77" status: 202 len: 0 microversion: 2.20 time: 0.707360 May 26 19:43:44.895038 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 356/702] 10.222.0.72 () {60 vars in 1456 bytes} [Thu May 26 19:43:44 2022] DELETE /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/os-volume_attachments/967a132d-6180-4bc0-95c3-2d98dcd35f77 => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 19:43:44.903872 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-da4c7873-1aa9-46fa-9c37-47f0bf17d620 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:44.904967 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-da4c7873-1aa9-46fa-9c37-47f0bf17d620 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:44.911688 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-da4c7873-1aa9-46fa-9c37-47f0bf17d620 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:44.912284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-da4c7873-1aa9-46fa-9c37-47f0bf17d620 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:44.913241 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-da4c7873-1aa9-46fa-9c37-47f0bf17d620 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:44.913358 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2747db2a-55cf-4425-9b51-9187c613a569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Going to try to stop instance {{(pid=124877) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 19:43:44.914231 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-da4c7873-1aa9-46fa-9c37-47f0bf17d620 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:44.949884 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-da4c7873-1aa9-46fa-9c37-47f0bf17d620 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050243 May 26 19:43:44.953243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 357/703] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:43:44 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:43:44.965503 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f865a1a4-0115-422d-a4f5-3e95456279f3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:43:44.966051 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f865a1a4-0115-422d-a4f5-3e95456279f3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:44.972007 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f865a1a4-0115-422d-a4f5-3e95456279f3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:44.972449 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f865a1a4-0115-422d-a4f5-3e95456279f3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:44.973194 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f865a1a4-0115-422d-a4f5-3e95456279f3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:44.973629 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f865a1a4-0115-422d-a4f5-3e95456279f3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:45.041623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:45.096998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2747db2a-55cf-4425-9b51-9187c613a569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/action" status: 202 len: 0 microversion: 2.1 time: 0.259919 May 26 19:43:45.097804 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 347/704] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:43:44 2022] POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 19:43:45.106922 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-42e41bfa-46b1-4170-9317-a1aa17300945 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:45.107620 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-42e41bfa-46b1-4170-9317-a1aa17300945 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:45.114020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e41bfa-46b1-4170-9317-a1aa17300945 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:45.114471 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e41bfa-46b1-4170-9317-a1aa17300945 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:45.115325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e41bfa-46b1-4170-9317-a1aa17300945 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:45.116268 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e41bfa-46b1-4170-9317-a1aa17300945 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:45.233923 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f865a1a4-0115-422d-a4f5-3e95456279f3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "POST /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/action" status: 202 len: 0 microversion: 2.20 time: 0.272026 May 26 19:43:45.235209 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 358/705] 10.222.0.72 () {62 vars in 1318 bytes} [Thu May 26 19:43:44 2022] POST /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 19:43:45.244753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:45.245990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:45.252716 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:45.253263 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:45.254126 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:45.254646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:45.259696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-42e41bfa-46b1-4170-9317-a1aa17300945 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:45.267705 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-42e41bfa-46b1-4170-9317-a1aa17300945 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.164930 May 26 19:43:45.277659 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 348/706] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:45 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:43:45.399430 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:45.416355 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:45.417915 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:45.419098 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-65cfe142-f998-4baf-bc34-3c8bc54bec12 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1673 microversion: 2.20 time: 0.179666 May 26 19:43:45.419658 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 359/707] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:45 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:43:45.962428 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-83d067c5-c9b6-4e06-9394-0a657563ecc4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:45.963379 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-83d067c5-c9b6-4e06-9394-0a657563ecc4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:45.969855 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-83d067c5-c9b6-4e06-9394-0a657563ecc4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:45.970316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-83d067c5-c9b6-4e06-9394-0a657563ecc4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:45.971122 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-83d067c5-c9b6-4e06-9394-0a657563ecc4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:45.971565 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-83d067c5-c9b6-4e06-9394-0a657563ecc4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:46.000047 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-83d067c5-c9b6-4e06-9394-0a657563ecc4 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042384 May 26 19:43:46.002727 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 349/708] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:43:45 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 19:43:46.061180 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-268aee6e-a4d1-4421-90d8-e5225feda8e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:46.061676 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-268aee6e-a4d1-4421-90d8-e5225feda8e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:46.067941 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-268aee6e-a4d1-4421-90d8-e5225feda8e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:46.068893 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-268aee6e-a4d1-4421-90d8-e5225feda8e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:46.069660 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-268aee6e-a4d1-4421-90d8-e5225feda8e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:46.070089 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-268aee6e-a4d1-4421-90d8-e5225feda8e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:46.097581 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-268aee6e-a4d1-4421-90d8-e5225feda8e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:43:46.285491 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3212110a-3fd7-4c4a-94cd-73c9d15f547a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:46.288543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3212110a-3fd7-4c4a-94cd-73c9d15f547a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:46.292396 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3212110a-3fd7-4c4a-94cd-73c9d15f547a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:46.292856 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3212110a-3fd7-4c4a-94cd-73c9d15f547a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:46.293662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3212110a-3fd7-4c4a-94cd-73c9d15f547a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:46.294103 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3212110a-3fd7-4c4a-94cd-73c9d15f547a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:46.392606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-268aee6e-a4d1-4421-90d8-e5225feda8e5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 204 len: 0 microversion: 2.1 time: 0.334145 May 26 19:43:46.399994 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 360/709] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:43:46 2022] DELETE /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:43:46.406768 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-005017a5-9b41-4192-8c67-be301823300e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:46.407501 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-005017a5-9b41-4192-8c67-be301823300e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:46.413562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-005017a5-9b41-4192-8c67-be301823300e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:46.414012 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-005017a5-9b41-4192-8c67-be301823300e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:46.414777 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-005017a5-9b41-4192-8c67-be301823300e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:46.415249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-005017a5-9b41-4192-8c67-be301823300e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:46.431290 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3212110a-3fd7-4c4a-94cd-73c9d15f547a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:46.439523 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3212110a-3fd7-4c4a-94cd-73c9d15f547a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.157892 May 26 19:43:46.440098 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 350/710] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:46 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:46.446466 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:46.447115 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:46.453472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:46.453926 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:46.454692 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:46.455157 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:46.554944 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-005017a5-9b41-4192-8c67-be301823300e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:46.562417 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-005017a5-9b41-4192-8c67-be301823300e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1682 microversion: 2.1 time: 0.160675 May 26 19:43:46.563213 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 361/711] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:46 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:46.585461 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:46.593321 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:46.595084 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:46.596032 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6510d328-7ebd-4ce9-983c-80e1f64809e9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1673 microversion: 2.20 time: 0.155031 May 26 19:43:46.596592 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 351/712] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:46 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:47.457539 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-549174f4-eb6b-4f00-a5a7-3df28041f7ac tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:47.458055 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-549174f4-eb6b-4f00-a5a7-3df28041f7ac tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:47.465296 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-549174f4-eb6b-4f00-a5a7-3df28041f7ac tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:47.465742 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-549174f4-eb6b-4f00-a5a7-3df28041f7ac tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:47.466498 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-549174f4-eb6b-4f00-a5a7-3df28041f7ac tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:47.466951 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-549174f4-eb6b-4f00-a5a7-3df28041f7ac tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:47.580142 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-46a8f29b-6c82-40f4-b05c-1eaec784d610 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:47.580750 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-46a8f29b-6c82-40f4-b05c-1eaec784d610 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:47.587953 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46a8f29b-6c82-40f4-b05c-1eaec784d610 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:47.588399 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46a8f29b-6c82-40f4-b05c-1eaec784d610 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:47.589266 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46a8f29b-6c82-40f4-b05c-1eaec784d610 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:47.589580 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46a8f29b-6c82-40f4-b05c-1eaec784d610 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:47.591761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-549174f4-eb6b-4f00-a5a7-3df28041f7ac tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:47.599630 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-549174f4-eb6b-4f00-a5a7-3df28041f7ac tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.146074 May 26 19:43:47.600221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 362/713] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:47 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:47.614969 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:47.615605 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:47.621753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:47.622200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:47.622983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:47.623419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:47.719708 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-46a8f29b-6c82-40f4-b05c-1eaec784d610 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:47.727195 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-46a8f29b-6c82-40f4-b05c-1eaec784d610 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1682 microversion: 2.1 time: 0.150840 May 26 19:43:47.727776 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 352/714] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:47 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:43:47.754513 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:47.764188 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:47.765674 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:47.766809 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3df05182-4986-45e4-b873-bc850aa21b74 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1675 microversion: 2.20 time: 0.155677 May 26 19:43:47.767395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 363/715] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:47 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:43:48.616577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0b6c8b67-d89f-471c-8b86-1d6fbc92ac72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:48.617209 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0b6c8b67-d89f-471c-8b86-1d6fbc92ac72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:48.623932 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0b6c8b67-d89f-471c-8b86-1d6fbc92ac72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:48.624312 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0b6c8b67-d89f-471c-8b86-1d6fbc92ac72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:48.625091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0b6c8b67-d89f-471c-8b86-1d6fbc92ac72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:48.625521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0b6c8b67-d89f-471c-8b86-1d6fbc92ac72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:48.746221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-4763a664-aca2-435f-9eb8-94be1fefbc24 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:48.746932 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-4763a664-aca2-435f-9eb8-94be1fefbc24 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:48.754665 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4763a664-aca2-435f-9eb8-94be1fefbc24 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:48.755237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4763a664-aca2-435f-9eb8-94be1fefbc24 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:48.756321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4763a664-aca2-435f-9eb8-94be1fefbc24 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:48.756829 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-4763a664-aca2-435f-9eb8-94be1fefbc24 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:48.781833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0b6c8b67-d89f-471c-8b86-1d6fbc92ac72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:48.798814 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0b6c8b67-d89f-471c-8b86-1d6fbc92ac72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.185963 May 26 19:43:48.799524 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 353/716] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:48 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:48.804528 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:48.805540 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:48.815216 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:48.815913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:48.816805 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:48.817337 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:48.899279 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-4763a664-aca2-435f-9eb8-94be1fefbc24 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:48.906754 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-4763a664-aca2-435f-9eb8-94be1fefbc24 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1682 microversion: 2.1 time: 0.165920 May 26 19:43:48.907357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 364/717] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:48 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:49.143195 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:49.151650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:49.153066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:49.154205 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6210a81e-84b8-4313-9b15-ff1cee926a33 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.353424 May 26 19:43:49.154755 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 354/718] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:48 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:49.816293 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ed18be3f-5094-42e6-bb28-2979c76a2fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:49.816919 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ed18be3f-5094-42e6-bb28-2979c76a2fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:49.824461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ed18be3f-5094-42e6-bb28-2979c76a2fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:49.824674 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ed18be3f-5094-42e6-bb28-2979c76a2fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:49.825327 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ed18be3f-5094-42e6-bb28-2979c76a2fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:49.825793 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ed18be3f-5094-42e6-bb28-2979c76a2fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:49.924164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8038e1f9-97d8-401e-b52d-67fedd7409b3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:49.924768 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8038e1f9-97d8-401e-b52d-67fedd7409b3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:49.932879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8038e1f9-97d8-401e-b52d-67fedd7409b3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:49.933000 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8038e1f9-97d8-401e-b52d-67fedd7409b3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:49.933732 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8038e1f9-97d8-401e-b52d-67fedd7409b3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:49.934377 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8038e1f9-97d8-401e-b52d-67fedd7409b3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:49.950570 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:49.973941 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ed18be3f-5094-42e6-bb28-2979c76a2fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:49.982846 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ed18be3f-5094-42e6-bb28-2979c76a2fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.170456 May 26 19:43:49.983493 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 365/719] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:49 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:50.040505 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8038e1f9-97d8-401e-b52d-67fedd7409b3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:50.046820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8038e1f9-97d8-401e-b52d-67fedd7409b3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1614 microversion: 2.1 time: 0.126490 May 26 19:43:50.047419 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 355/720] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:49 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1614 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:43:50.172575 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:50.174234 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:50.178418 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-378b9a14-dc2d-4129-a748-ac2d3a478ece req-f3d93843-2fe9-4498-baa2-a896eb4628af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b3cb81-bd61-4e0e-bb00-6c40deb52f1b", "name": "network-vif-deleted", "tag": "c5e1749f-1285-4e41-9fd3-c9a4834b4493"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:43:50.183249 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:50.189791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:50.189791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:50.189791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:50.203171 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-378b9a14-dc2d-4129-a748-ac2d3a478ece req-f3d93843-2fe9-4498-baa2-a896eb4628af service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:50.203616 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-378b9a14-dc2d-4129-a748-ac2d3a478ece req-f3d93843-2fe9-4498-baa2-a896eb4628af service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:50.384763 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:50.394764 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:50.397768 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:50.399446 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9de10c82-9158-4ec6-be99-47b262a4f5ff tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.230904 May 26 19:43:50.410579 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 356/721] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:50 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:43:50.450434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-378b9a14-dc2d-4129-a748-ac2d3a478ece req-f3d93843-2fe9-4498-baa2-a896eb4628af service nova] Creating event network-vif-deleted:c5e1749f-1285-4e41-9fd3-c9a4834b4493 for instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b on hv-cinder-82549 May 26 19:43:50.456761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-378b9a14-dc2d-4129-a748-ac2d3a478ece req-f3d93843-2fe9-4498-baa2-a896eb4628af service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299404 May 26 19:43:50.457321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 366/722] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:43:50.999560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3824a8ec-098c-4ef4-b2bc-d9714e411249 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:51.000163 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3824a8ec-098c-4ef4-b2bc-d9714e411249 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:51.008818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3824a8ec-098c-4ef4-b2bc-d9714e411249 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:51.012767 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3824a8ec-098c-4ef4-b2bc-d9714e411249 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:51.013808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3824a8ec-098c-4ef4-b2bc-d9714e411249 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:51.017218 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3824a8ec-098c-4ef4-b2bc-d9714e411249 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:51.066609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:51.067923 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:51.076757 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:51.077672 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:51.078801 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:51.079527 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:51.119235 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:51.119940 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:51.120553 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:51.180628 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:51.189417 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-aba4c93a-a284-4e02-80a8-ce47901326b8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.127227 May 26 19:43:51.201688 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 367/723] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:51 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:43:51.224038 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3824a8ec-098c-4ef4-b2bc-d9714e411249 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:51.234601 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3824a8ec-098c-4ef4-b2bc-d9714e411249 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.238906 May 26 19:43:51.235702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 357/724] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:50 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:51.418339 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:51.419189 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:51.425736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:51.426182 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:51.426988 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:51.427496 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:51.585032 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:51.593731 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:51.595572 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:51.596957 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-009cdf70-32c2-43fb-a398-a1f4aa167bf0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.182723 May 26 19:43:51.608490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 368/725] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:51 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:52.207086 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:52.207679 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:52.219153 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:52.219942 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:52.220887 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:52.221313 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:52.252647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-43673c58-e293-419c-b09e-bc6b3c6ab052 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:52.253252 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-43673c58-e293-419c-b09e-bc6b3c6ab052 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:52.258034 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:52.258637 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:52.260534 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-43673c58-e293-419c-b09e-bc6b3c6ab052 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:52.260987 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-43673c58-e293-419c-b09e-bc6b3c6ab052 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:52.261753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-43673c58-e293-419c-b09e-bc6b3c6ab052 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:52.262185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-43673c58-e293-419c-b09e-bc6b3c6ab052 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:52.263391 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:52.311824 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:52.321291 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1c2d230d-23fd-4b94-905b-a163c073f50e tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.118150 May 26 19:43:52.322011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 358/726] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:52 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:52.407799 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-43673c58-e293-419c-b09e-bc6b3c6ab052 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:52.416822 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-43673c58-e293-419c-b09e-bc6b3c6ab052 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.167897 May 26 19:43:52.417396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 369/727] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:52 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:52.616567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:52.617173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:52.623394 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:52.623849 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:52.624612 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:52.625050 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:52.755949 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:52.764452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:52.765996 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:52.767477 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9f9aa2f9-a01f-453e-b71f-203770e1c584 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.155587 May 26 19:43:52.768041 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 359/728] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:52 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:53.339764 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:53.340481 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:53.346621 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:53.347119 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:53.347911 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:53.348350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:53.384170 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:53.384618 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:53.385070 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:53.429352 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:53.433698 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7e25d993-3169-4a98-a036-e0efa679d3ec tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:53.434327 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7e25d993-3169-4a98-a036-e0efa679d3ec tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:53.439472 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7ad2b25c-d09c-46ac-84ae-b8abd8bb5602 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.104279 May 26 19:43:53.440255 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 370/729] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:53 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:53.441869 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7e25d993-3169-4a98-a036-e0efa679d3ec tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:53.442301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7e25d993-3169-4a98-a036-e0efa679d3ec tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:53.443119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7e25d993-3169-4a98-a036-e0efa679d3ec tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:53.444139 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7e25d993-3169-4a98-a036-e0efa679d3ec tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:53.585118 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7e25d993-3169-4a98-a036-e0efa679d3ec tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:53.593465 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7e25d993-3169-4a98-a036-e0efa679d3ec tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.163572 May 26 19:43:53.603652 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 360/730] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:53 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:53.785646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:53.786302 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:53.792926 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:53.793371 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:53.794130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:53.794567 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:53.933237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:53.941480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:53.943013 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:53.944255 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5f383f1b-1ada-407b-afb2-79c29e5b684e tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.162671 May 26 19:43:53.944791 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 371/731] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:53 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:43:54.457121 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:54.458333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:54.465486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:54.465945 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:54.466922 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:54.467363 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:54.499660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:54.500109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:54.500562 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:54.544560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:54.552166 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-07b3b32e-57f0-46f7-9802-f9296073c4a5 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.098998 May 26 19:43:54.553275 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 361/732] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:54 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:54.610718 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-48155fd9-d8cb-4614-9925-2d90121eb50f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:54.611409 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-48155fd9-d8cb-4614-9925-2d90121eb50f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:54.619368 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-48155fd9-d8cb-4614-9925-2d90121eb50f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:54.619878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-48155fd9-d8cb-4614-9925-2d90121eb50f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:54.620601 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-48155fd9-d8cb-4614-9925-2d90121eb50f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:54.621040 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-48155fd9-d8cb-4614-9925-2d90121eb50f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:54.773721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-48155fd9-d8cb-4614-9925-2d90121eb50f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:54.782711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-48155fd9-d8cb-4614-9925-2d90121eb50f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.175840 May 26 19:43:54.783538 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 372/733] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:54 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:54.962630 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:54.963438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:54.970209 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:54.970881 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:54.971733 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:54.972172 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:55.108531 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:55.117483 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:55.119479 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:55.120646 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d7a15d6c-1cf3-4632-bcbd-b891947952da tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.162269 May 26 19:43:55.121398 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 362/734] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:54 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:55.570153 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:55.570763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:55.576923 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:55.577366 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:55.578136 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:55.578569 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:55.594663 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:55.611200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:55.611837 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:55.612073 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:55.654483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:55.661964 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ba29aa8f-6fc3-4d99-ad1b-4b2717a13e54 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.096245 May 26 19:43:55.662531 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 373/735] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:55 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:55.800432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5481416b-0e6b-4772-bd96-a767684b0998 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:55.801043 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5481416b-0e6b-4772-bd96-a767684b0998 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:55.819862 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5481416b-0e6b-4772-bd96-a767684b0998 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:55.820310 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5481416b-0e6b-4772-bd96-a767684b0998 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:55.821082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5481416b-0e6b-4772-bd96-a767684b0998 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:55.821514 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5481416b-0e6b-4772-bd96-a767684b0998 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:55.969039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5481416b-0e6b-4772-bd96-a767684b0998 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:55.980002 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5481416b-0e6b-4772-bd96-a767684b0998 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.182930 May 26 19:43:55.989557 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 363/736] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:55 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:56.140370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:56.141299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:56.148655 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:56.149101 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:56.149897 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:56.150428 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:56.288424 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:56.297034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:56.298609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:56.299867 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d002f238-059b-490a-83a5-a57496710c41 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.163519 May 26 19:43:56.300429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 374/737] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:56 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:56.679079 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:56.679704 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:56.694777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:56.695289 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:56.696066 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:56.696503 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:56.727572 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:56.728023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:56.728474 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:56.769878 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:56.777678 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6db1f1c6-ef6f-443c-adea-12c40d160686 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.102870 May 26 19:43:56.778450 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 364/738] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:56 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:56.998093 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-057d50ab-410e-4ff1-bd4e-621356cbc569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:56.998738 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-057d50ab-410e-4ff1-bd4e-621356cbc569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:57.004990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-057d50ab-410e-4ff1-bd4e-621356cbc569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:57.005438 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-057d50ab-410e-4ff1-bd4e-621356cbc569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:57.006833 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-057d50ab-410e-4ff1-bd4e-621356cbc569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:57.007288 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-057d50ab-410e-4ff1-bd4e-621356cbc569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:57.143531 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-057d50ab-410e-4ff1-bd4e-621356cbc569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:57.151594 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-057d50ab-410e-4ff1-bd4e-621356cbc569 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.158269 May 26 19:43:57.152362 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 375/739] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:56 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:57.319635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:57.320371 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:57.327047 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:57.327505 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:57.328274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:57.329044 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:57.482834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:57.491224 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:57.492744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:57.494247 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-69e0b090-8a0b-49b3-81d3-7911217ec529 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.178494 May 26 19:43:57.496838 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 365/740] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:57 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:57.794933 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:57.795552 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:57.801764 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:57.802218 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:57.803059 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:57.803504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:57.835687 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:57.836140 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:57.836596 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:57.890576 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:57.899183 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8df50835-1be2-485e-a5c9-dca14648f7d3 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.108037 May 26 19:43:57.899761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 376/741] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:57 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:43:58.169112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-469bd9d8-dc5e-4991-856e-3da690aa1983 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:58.169713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-469bd9d8-dc5e-4991-856e-3da690aa1983 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:58.175878 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-469bd9d8-dc5e-4991-856e-3da690aa1983 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:58.176331 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-469bd9d8-dc5e-4991-856e-3da690aa1983 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:58.177080 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-469bd9d8-dc5e-4991-856e-3da690aa1983 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:58.178271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-469bd9d8-dc5e-4991-856e-3da690aa1983 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:58.315628 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-469bd9d8-dc5e-4991-856e-3da690aa1983 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:58.325550 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-469bd9d8-dc5e-4991-856e-3da690aa1983 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.160200 May 26 19:43:58.326966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 366/742] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:58 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:58.513584 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:58.514176 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:58.521250 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:58.521816 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:58.522684 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:58.523165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:58.656550 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:58.665015 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:58.666542 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:58.667756 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-91b5bafa-cb37-4c3c-8abe-6659193313c9 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.158122 May 26 19:43:58.668312 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 377/743] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:58 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:43:58.916514 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:58.917037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:58.923339 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:58.923732 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:58.924491 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:58.924964 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:58.958451 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:58.959739 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:58.960136 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:43:59.002166 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:59.009720 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-eb203584-2e9a-4178-80af-2627e0e09569 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.097714 May 26 19:43:59.010276 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 367/744] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:58 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:59.342299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f2bde160-214e-4991-ba70-9aa68d49e941 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:59.348830 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f2bde160-214e-4991-ba70-9aa68d49e941 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:59.349103 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f2bde160-214e-4991-ba70-9aa68d49e941 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:59.349560 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f2bde160-214e-4991-ba70-9aa68d49e941 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:59.350334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f2bde160-214e-4991-ba70-9aa68d49e941 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:59.350763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f2bde160-214e-4991-ba70-9aa68d49e941 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:59.493355 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f2bde160-214e-4991-ba70-9aa68d49e941 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:59.502324 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f2bde160-214e-4991-ba70-9aa68d49e941 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1724 microversion: 2.1 time: 0.163871 May 26 19:43:59.503027 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 378/745] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:43:59 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:43:59.686562 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:43:59.687201 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:43:59.693910 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:59.695030 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:59.695807 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:43:59.696246 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:43:59.822235 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:59.830120 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:59.831692 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:43:59.832826 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f5baf8e3-d5bc-4f95-8fb6-59ebe28f03e3 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.150243 May 26 19:43:59.833386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 368/746] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:43:59 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:00.025691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:00.026283 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:00.032686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.033130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:00.033878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.034310 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:00.064695 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.065134 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:00.065577 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:44:00.105159 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:00.112519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c8ccfcf5-8814-4b14-abd7-a218d5d89bcc tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.090909 May 26 19:44:00.113076 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 379/747] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:00 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:00.523707 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9c608bbe-59c5-4f24-bdd6-cebdb693ef6a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:00.524303 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9c608bbe-59c5-4f24-bdd6-cebdb693ef6a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:00.530650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9c608bbe-59c5-4f24-bdd6-cebdb693ef6a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.531209 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9c608bbe-59c5-4f24-bdd6-cebdb693ef6a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:00.532007 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9c608bbe-59c5-4f24-bdd6-cebdb693ef6a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.532493 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9c608bbe-59c5-4f24-bdd6-cebdb693ef6a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:00.668039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9c608bbe-59c5-4f24-bdd6-cebdb693ef6a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:00.676230 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9c608bbe-59c5-4f24-bdd6-cebdb693ef6a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1701 microversion: 2.1 time: 0.157038 May 26 19:44:00.678869 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 369/748] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:00 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:00.692356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-52bd6b0d-3c8a-41ae-8132-9815b292ef4b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:44:00.698395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-52bd6b0d-3c8a-41ae-8132-9815b292ef4b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.698841 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-52bd6b0d-3c8a-41ae-8132-9815b292ef4b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:00.759649 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-52bd6b0d-3c8a-41ae-8132-9815b292ef4b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Going to try to start instance {{(pid=124876) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 19:44:00.850718 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:00.851401 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:00.857869 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.858319 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:00.859119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.859555 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:00.976938 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-52bd6b0d-3c8a-41ae-8132-9815b292ef4b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/action" status: 202 len: 0 microversion: 2.1 time: 0.288162 May 26 19:44:00.977598 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 380/749] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:44:00 2022] POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:44:00.986047 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c25d8236-ad0d-4078-a8f4-e15c05435808 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:00.987790 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c25d8236-ad0d-4078-a8f4-e15c05435808 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:00.991411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:00.993115 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c25d8236-ad0d-4078-a8f4-e15c05435808 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.993855 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c25d8236-ad0d-4078-a8f4-e15c05435808 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:00.994088 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=100 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:00.994627 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c25d8236-ad0d-4078-a8f4-e15c05435808 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:00.995123 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c25d8236-ad0d-4078-a8f4-e15c05435808 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:01.000492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:01.001987 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:01.003164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-01371fc8-46ac-4594-b187-975ec4d6199b tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.156314 May 26 19:44:01.003841 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 370/750] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:00 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:44:01.126207 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c25d8236-ad0d-4078-a8f4-e15c05435808 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:01.134199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:01.134855 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:01.135044 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c25d8236-ad0d-4078-a8f4-e15c05435808 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1710 microversion: 2.1 time: 0.152854 May 26 19:44:01.135488 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 381/751] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:00 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:44:01.141193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:01.141634 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:01.142384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:01.142813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:01.171589 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:01.172030 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:01.172467 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lazy-loading 'fault' on Instance uuid 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:44:01.215614 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841abe37b81f47d2a95140e46b12ea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:01.222943 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-77982db7-a752-4f32-86fb-83a89546d2be tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 200 len: 1331 microversion: 2.1 time: 0.093492 May 26 19:44:01.223504 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 371/752] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:01 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:44:02.021450 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:02.022092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:02.028331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:02.028786 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:02.029679 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:02.030125 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:02.152129 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-79ed52fc-24fb-4dd1-b6bc-02c08f4606d3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:02.152739 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-79ed52fc-24fb-4dd1-b6bc-02c08f4606d3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:02.159826 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-79ed52fc-24fb-4dd1-b6bc-02c08f4606d3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:02.160272 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-79ed52fc-24fb-4dd1-b6bc-02c08f4606d3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:02.161041 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-79ed52fc-24fb-4dd1-b6bc-02c08f4606d3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:02.161474 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-79ed52fc-24fb-4dd1-b6bc-02c08f4606d3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:02.162021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:02.170301 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:02.172124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:02.173376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ae8766ea-8723-4699-8337-b2fbbb243de0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.155934 May 26 19:44:02.174261 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 382/753] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:02 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:02.240344 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:02.240344 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:02.247724 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:02.248173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:02.248942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:02.249377 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:02.263658 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b HTTP/1.1 May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:44:02.265350 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:02.266802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '87b3cb81-bd61-4e0e-bb00-6c40deb52f1b'} May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:02.267646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:02.268913 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:02.270005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:02.270005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1382f4f1-6064-47ef-a5d7-1a29afe3b6db tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 404 len: 111 microversion: 2.1 time: 0.030961 May 26 19:44:02.270005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 383/754] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:02 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:44:02.275229 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d5feb187-eda9-45a0-8675-c1d5c59374f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '.version_select at 0x7fa788f31310>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:02.363188 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d5feb187-eda9-45a0-8675-c1d5c59374f8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922826672" status: 202 len: 0 microversion: 2.1 time: 0.091313 May 26 19:44:02.367917 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 384/755] 10.222.0.72 () {58 vars in 1217 bytes} [Thu May 26 19:44:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922826672 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 19:44:02.486286 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-79ed52fc-24fb-4dd1-b6bc-02c08f4606d3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:02.499916 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-79ed52fc-24fb-4dd1-b6bc-02c08f4606d3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1710 microversion: 2.1 time: 0.351532 May 26 19:44:02.500721 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 372/756] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:02 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1710 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:44:03.192608 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:03.193237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:03.200600 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:03.201051 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:03.201812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:03.202249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:03.337427 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:03.346236 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:03.347973 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:03.349169 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-86c9430e-0e2c-4f05-8e95-e866b3102776 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.161041 May 26 19:44:03.349805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 385/757] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:03 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:03.517634 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3bf3b0a0-4bff-4b51-9542-ef4984895b22 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:03.518304 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3bf3b0a0-4bff-4b51-9542-ef4984895b22 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:03.524719 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3bf3b0a0-4bff-4b51-9542-ef4984895b22 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:03.525161 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3bf3b0a0-4bff-4b51-9542-ef4984895b22 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:03.525906 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3bf3b0a0-4bff-4b51-9542-ef4984895b22 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:03.526334 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3bf3b0a0-4bff-4b51-9542-ef4984895b22 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:03.660812 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3bf3b0a0-4bff-4b51-9542-ef4984895b22 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:03.669291 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3bf3b0a0-4bff-4b51-9542-ef4984895b22 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1710 microversion: 2.1 time: 0.155654 May 26 19:44:03.670137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 373/758] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:03 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:04.368834 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:04.369560 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:04.376429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:04.376903 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:04.377673 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:04.378112 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:04.411984 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:04.412477 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:04.419976 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:04.420435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:04.421236 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:04.421797 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:04.440775 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: DELETE /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b HTTP/1.1 May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:44:04.442508 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.444023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '87b3cb81-bd61-4e0e-bb00-6c40deb52f1b'} May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:04.445217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.446688 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.448697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:04.448697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-995c09fd-dc72-4cb4-ae3e-e2fb55622709 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 404 len: 111 microversion: 2.1 time: 0.035739 May 26 19:44:04.448697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 374/759] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:44:04 2022] DELETE /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:44:04.457093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:04.457868 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:04.464632 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:04.465152 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:04.465865 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:04.466303 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:04.481838 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b HTTP/1.1 May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:44:04.483525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.485004 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '87b3cb81-bd61-4e0e-bb00-6c40deb52f1b'} May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:04.489049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. May 26 19:44:04.490455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:04.491807 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance 87b3cb81-bd61-4e0e-bb00-6c40deb52f1b could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:04.491807 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d7e0d6e9-05a0-4c6f-989a-ae35efd3eb3f tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b" status: 404 len: 111 microversion: 2.1 time: 0.036191 May 26 19:44:04.491807 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 375/760] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:04 2022] GET /compute/v2.1/servers/87b3cb81-bd61-4e0e-bb00-6c40deb52f1b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:44:04.522838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:04.531554 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:04.533038 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:04.534188 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-eeedf6ae-c315-4b48-bd3f-172d72173c53 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.170003 May 26 19:44:04.534744 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 386/761] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:04 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:04.688198 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-78961207-dd0b-4921-8303-8dfa6eb636cb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:04.688820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-78961207-dd0b-4921-8303-8dfa6eb636cb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:04.695975 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78961207-dd0b-4921-8303-8dfa6eb636cb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:04.696422 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78961207-dd0b-4921-8303-8dfa6eb636cb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:04.697173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78961207-dd0b-4921-8303-8dfa6eb636cb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:04.697601 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-78961207-dd0b-4921-8303-8dfa6eb636cb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:04.838024 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-78961207-dd0b-4921-8303-8dfa6eb636cb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:04.846111 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-78961207-dd0b-4921-8303-8dfa6eb636cb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1714 microversion: 2.1 time: 0.161806 May 26 19:44:04.846667 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 376/762] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:04 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:05.552511 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:05.553114 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:05.560096 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:05.560622 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:05.561432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:05.561965 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:05.694011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:05.703569 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:05.705080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:05.706244 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3a2554a7-ea49-4441-991c-557025d9768f tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.157844 May 26 19:44:05.706990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 387/763] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:05 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:05.795773 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-df3fdccb-1cdd-4faf-b4d8-8e449da56faa req-35e0bc62-4c40-4f4d-9c98-72d57bafa71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d37e4a7-2599-4466-b249-a142cf7770f0", "name": "network-vif-plugged", "status": "completed", "tag": "81fa53c7-4d30-4a24-9182-ad976ec89b2b"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:44:05.805008 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-df3fdccb-1cdd-4faf-b4d8-8e449da56faa req-35e0bc62-4c40-4f4d-9c98-72d57bafa71b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:05.805391 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-df3fdccb-1cdd-4faf-b4d8-8e449da56faa req-35e0bc62-4c40-4f4d-9c98-72d57bafa71b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:05.818161 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-df3fdccb-1cdd-4faf-b4d8-8e449da56faa req-35e0bc62-4c40-4f4d-9c98-72d57bafa71b service nova] Creating event network-vif-plugged:81fa53c7-4d30-4a24-9182-ad976ec89b2b for instance 7d37e4a7-2599-4466-b249-a142cf7770f0 on hv-cinder-82549 May 26 19:44:05.823796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-df3fdccb-1cdd-4faf-b4d8-8e449da56faa req-35e0bc62-4c40-4f4d-9c98-72d57bafa71b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031742 May 26 19:44:05.834862 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 377/764] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:44:06.488472 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:06.488991 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:06.491023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:06.495954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.496397 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.497187 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.497620 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.510530 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 HTTP/1.1 May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:44:06.512082 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.513613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '1aefdfc4-c74d-48dd-8945-bdd21a5c0566'} May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:06.514614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.516092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.517849 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:06.517849 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-437bf2ef-9d11-4e9a-adf3-c636c819cb46 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 404 len: 111 microversion: 2.1 time: 0.028964 May 26 19:44:06.517849 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 388/765] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:44:06 2022] DELETE /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:44:06.522372 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:06.523730 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 1aefdfc4-c74d-48dd-8945-bdd21a5c0566] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:06.537970 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.538560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.540129 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.540578 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.563846 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 HTTP/1.1 May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:44:06.565501 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.567016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '1aefdfc4-c74d-48dd-8945-bdd21a5c0566'} May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:06.572789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. May 26 19:44:06.575837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.578099 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance 1aefdfc4-c74d-48dd-8945-bdd21a5c0566 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:06.578099 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bb89ab98-962b-4c82-9b46-83291a4aa746 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566" status: 404 len: 111 microversion: 2.1 time: 0.048833 May 26 19:44:06.578099 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 378/766] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:06 2022] GET /compute/v2.1/servers/1aefdfc4-c74d-48dd-8945-bdd21a5c0566 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:44:06.578547 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:06.579316 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:06.595736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.596355 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.597145 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.598367 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.614411 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 HTTP/1.1 May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:44:06.615998 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.617555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '52eb678d-5cbe-4e95-914d-09d3165544f3'} May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:06.618491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.624249 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:06.625692 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:06.625692 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e33b1832-9ebd-41d7-a2bf-4f75ec0b7301 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 404 len: 111 microversion: 2.1 time: 0.045825 May 26 19:44:06.625692 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 389/767] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:44:06 2022] DELETE /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:44:06.626041 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:06.626650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: 52eb678d-5cbe-4e95-914d-09d3165544f3] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:06.632731 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.633185 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.633996 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.634430 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.647492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 HTTP/1.1 May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:44:06.649511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.651215 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '52eb678d-5cbe-4e95-914d-09d3165544f3'} May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:06.652245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. May 26 19:44:06.653666 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:06.655079 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance 52eb678d-5cbe-4e95-914d-09d3165544f3 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:06.655079 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9f8a4474-1620-444f-9367-657a826edcee tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3" status: 404 len: 111 microversion: 2.1 time: 0.028638 May 26 19:44:06.655079 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 379/768] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:06 2022] GET /compute/v2.1/servers/52eb678d-5cbe-4e95-914d-09d3165544f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:44:06.725154 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:06.725685 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:06.732268 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.732714 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.733470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:06.733904 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:06.863250 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:06.871400 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:06.872904 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:06.874162 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c47bc45c-575a-4030-8d38-43f373fe23be tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.153166 May 26 19:44:06.874725 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 390/769] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:06 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:07.894095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:07.894652 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:07.901766 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:07.902336 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:07.903123 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:07.903554 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:07.927596 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:07.928145 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:07.934769 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:07.935268 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:07.936043 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:07.936481 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:07.940459 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:07.949886 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 HTTP/1.1 May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:44:07.951480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:07.953080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': 'cee8cee6-5c93-4631-a2c1-f371a167fe97'} May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:07.953902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:07.955357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:07.956822 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:07.956822 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6ab4380f-0899-497b-aa4f-727dff9e1ca1 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 404 len: 111 microversion: 2.1 time: 0.029617 May 26 19:44:07.956822 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 391/770] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:44:07 2022] DELETE /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:44:07.961179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:07.961787 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] [instance: cee8cee6-5c93-4631-a2c1-f371a167fe97] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:07.978053 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:07.978789 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:07.979792 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:07.980230 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:07.996494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] HTTP exception thrown: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Request method failure captured: May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 HTTP/1.1 May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9bdnCH2Q_6SO6kCy2t_rAKxWsn8ouE9omay3lMUA8VBEbaU30rmwFIe3wmLSEg0Egt1NeFui-jVvV_oQwVS2VV-YmVGcRi9rpFY9hSQXUsnISf4IsGfLc2pn26Ib36wH-FDDN7e381uwpV5NiSqXmRunlQXHt8501jgwU6E_2ifMkw May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:44:07.997947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f75b0f65c4475ba2d5dc1e7ae203ba", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f75b0f65c4475ba2d5dc1e7ae203ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 39f75b0f65c4475ba2d5dc1e7ae203ba May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1271517145 May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 841abe37b81f47d2a95140e46b12ea08 May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeNegativeTest-1271517145-project May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:07.999512 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': 'cee8cee6-5c93-4631-a2c1-f371a167fe97'} May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:08.000974 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. May 26 19:44:08.002389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:08.003895 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] Returning 404 to user: Instance cee8cee6-5c93-4631-a2c1-f371a167fe97 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:08.003895 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2e9e9d77-f956-47cb-be99-8f9de83b0af8 tempest-AttachVolumeNegativeTest-1271517145 tempest-AttachVolumeNegativeTest-1271517145-project] 10.222.0.72 "GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97" status: 404 len: 111 microversion: 2.1 time: 0.041864 May 26 19:44:08.003895 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 392/771] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:07 2022] GET /compute/v2.1/servers/cee8cee6-5c93-4631-a2c1-f371a167fe97 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:44:08.060065 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:08.068476 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:08.081665 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:08.081665 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8f585429-f5de-486c-b046-aa75d51d0b37 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1731 microversion: 2.20 time: 0.181464 May 26 19:44:08.081665 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 380/772] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:07 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:09.090333 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:09.091145 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:09.098386 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:09.099174 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:09.100079 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:09.100587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:09.260878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:09.269636 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:09.271176 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:09.272520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-083fc80a-8357-4b4b-887f-5724f2c3e4ed tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1718 microversion: 2.20 time: 0.187080 May 26 19:44:09.273088 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 393/773] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:09 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1718 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:42.293447 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-70b172c6-417f-46c1-8182-8ea08466caeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:42.295002 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-70b172c6-417f-46c1-8182-8ea08466caeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:42.297530 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=81 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:42.298224 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=43 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:42.303046 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-70b172c6-417f-46c1-8182-8ea08466caeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:42.303488 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-70b172c6-417f-46c1-8182-8ea08466caeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:42.304253 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-70b172c6-417f-46c1-8182-8ea08466caeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:42.304694 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-70b172c6-417f-46c1-8182-8ea08466caeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:42.340063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-70b172c6-417f-46c1-8182-8ea08466caeb tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050506 May 26 19:44:42.340630 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 381/774] 10.222.0.72 () {60 vars in 1342 bytes} [Thu May 26 19:44:42 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:42.405173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1566d181-93b0-48e9-97b3-a4142c0d87e0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:42.405711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1566d181-93b0-48e9-97b3-a4142c0d87e0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:42.407981 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=11 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:42.408630 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=9 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:42.413409 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1566d181-93b0-48e9-97b3-a4142c0d87e0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:42.416672 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1566d181-93b0-48e9-97b3-a4142c0d87e0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:42.416672 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1566d181-93b0-48e9-97b3-a4142c0d87e0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:42.416672 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1566d181-93b0-48e9-97b3-a4142c0d87e0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:42.439541 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1566d181-93b0-48e9-97b3-a4142c0d87e0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:44:42.745246 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1566d181-93b0-48e9-97b3-a4142c0d87e0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 204 len: 0 microversion: 2.20 time: 0.344114 May 26 19:44:42.745866 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 394/775] 10.222.0.72 () {60 vars in 1279 bytes} [Thu May 26 19:44:42 2022] DELETE /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 19:44:42.754994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:42.755594 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:42.761846 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:42.762290 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:42.763726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:42.764237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:42.896914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:42.903975 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:42.905497 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:42.906659 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e3117cec-3208-411f-8720-6c0a14d0f016 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.156818 May 26 19:44:42.907505 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 382/776] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:42 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:43.593742 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ff949e28-410c-4736-b044-17e34cfd8e2e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:43.594270 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ff949e28-410c-4736-b044-17e34cfd8e2e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:43.600750 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ff949e28-410c-4736-b044-17e34cfd8e2e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:43.601199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ff949e28-410c-4736-b044-17e34cfd8e2e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:43.601968 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ff949e28-410c-4736-b044-17e34cfd8e2e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:43.602410 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ff949e28-410c-4736-b044-17e34cfd8e2e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:43.687092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-ff949e28-410c-4736-b044-17e34cfd8e2e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lazy-loading 'services' on Instance uuid 2ae90233-1398-44cd-9ac0-9d660d9b6e64 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:44:43.909803 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ff949e28-410c-4736-b044-17e34cfd8e2e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/os-volume_attachments/eadf2580-5256-4201-9757-090d451d9a15" status: 202 len: 0 microversion: 2.1 time: 0.320315 May 26 19:44:43.910313 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 395/777] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:44:43 2022] DELETE /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/os-volume_attachments/eadf2580-5256-4201-9757-090d451d9a15 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:44:43.925010 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:43.925635 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:43.932426 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:43.932872 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:43.933622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:43.934054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:44.068164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:44.075371 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:44.076859 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:44.078001 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-604ee6fd-089b-4ce2-b5b7-0c704404af61 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.157309 May 26 19:44:44.078576 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 383/778] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:43 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:45.096915 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:45.097606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:45.105072 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:45.105332 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:45.106817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:45.107438 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:45.252715 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:45.260929 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:45.262440 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:45.263633 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c645b988-68d4-4b10-8b41-9b59d7750a79 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1724 microversion: 2.20 time: 0.170860 May 26 19:44:45.270612 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 396/779] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:45 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:45.560298 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-ac65cdbf-61c1-42ee-af28-8720382840a2 req-51f1faf2-eb0d-438d-86c5-dd3d6ada2737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d37e4a7-2599-4466-b249-a142cf7770f0", "name": "network-vif-deleted", "tag": "81fa53c7-4d30-4a24-9182-ad976ec89b2b"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:44:45.569082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-ac65cdbf-61c1-42ee-af28-8720382840a2 req-51f1faf2-eb0d-438d-86c5-dd3d6ada2737 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:45.569522 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-ac65cdbf-61c1-42ee-af28-8720382840a2 req-51f1faf2-eb0d-438d-86c5-dd3d6ada2737 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:45.580660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-ac65cdbf-61c1-42ee-af28-8720382840a2 req-51f1faf2-eb0d-438d-86c5-dd3d6ada2737 service nova] Creating event network-vif-deleted:81fa53c7-4d30-4a24-9182-ad976ec89b2b for instance 7d37e4a7-2599-4466-b249-a142cf7770f0 on hv-cinder-82549 May 26 19:44:45.585690 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-ac65cdbf-61c1-42ee-af28-8720382840a2 req-51f1faf2-eb0d-438d-86c5-dd3d6ada2737 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 May 26 19:44:45.586300 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 384/780] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:44:46.181916 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6818bc7c-5a31-4708-8fc1-ea9beb75da31 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:44:46.188597 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6818bc7c-5a31-4708-8fc1-ea9beb75da31 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:46.189043 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6818bc7c-5a31-4708-8fc1-ea9beb75da31 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:46.212173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6818bc7c-5a31-4708-8fc1-ea9beb75da31 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Going to try to stop instance {{(pid=124876) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 19:44:46.282614 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:46.283415 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:46.292511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:46.292958 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:46.294528 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:46.295029 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:46.371345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:46.380181 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:46.381677 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:46.382856 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6ec65c3d-aa09-4dac-a3d0-759d3afaffe4 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1656 microversion: 2.20 time: 0.105023 May 26 19:44:46.383461 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 385/781] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:46 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1656 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 19:44:46.444092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6818bc7c-5a31-4708-8fc1-ea9beb75da31 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/action" status: 202 len: 0 microversion: 2.1 time: 0.265881 May 26 19:44:46.444703 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 397/782] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:44:46 2022] POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:44:46.453124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9194918b-5239-4e65-a64e-5b2cd02f58e3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:46.453742 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9194918b-5239-4e65-a64e-5b2cd02f58e3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:46.459772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9194918b-5239-4e65-a64e-5b2cd02f58e3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:46.460223 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9194918b-5239-4e65-a64e-5b2cd02f58e3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:46.460990 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9194918b-5239-4e65-a64e-5b2cd02f58e3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:46.461432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9194918b-5239-4e65-a64e-5b2cd02f58e3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:46.592477 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9194918b-5239-4e65-a64e-5b2cd02f58e3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:46.600196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9194918b-5239-4e65-a64e-5b2cd02f58e3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.151392 May 26 19:44:46.600759 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 386/783] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:46 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:47.403960 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:47.404661 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:47.410956 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:47.411407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:47.412176 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:47.412610 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:47.474360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:47.482969 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:47.484471 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:47.485618 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2a821a00-e534-41e1-adf2-2ca33e43dda0 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1656 microversion: 2.20 time: 0.086549 May 26 19:44:47.486172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 398/784] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:47 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:47.617668 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f93bff55-82f7-4cef-aa54-1dfeca2885f5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:47.618282 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f93bff55-82f7-4cef-aa54-1dfeca2885f5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:47.625301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f93bff55-82f7-4cef-aa54-1dfeca2885f5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:47.625691 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f93bff55-82f7-4cef-aa54-1dfeca2885f5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:47.626457 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f93bff55-82f7-4cef-aa54-1dfeca2885f5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:47.626926 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f93bff55-82f7-4cef-aa54-1dfeca2885f5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:47.753100 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f93bff55-82f7-4cef-aa54-1dfeca2885f5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:47.760882 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f93bff55-82f7-4cef-aa54-1dfeca2885f5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.147036 May 26 19:44:47.761478 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 387/785] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:47 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:48.505154 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:48.505759 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:48.512295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:48.512752 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:48.514080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:48.514522 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:48.546002 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:48.546451 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:48.546922 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lazy-loading 'fault' on Instance uuid 7d37e4a7-2599-4466-b249-a142cf7770f0 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:44:48.591570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:48.599361 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:48.600855 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1327d80a17743daa137acaad895cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189404964f64aa88af37e536c1c7464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:48.602000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ffa24011-993d-4ed8-b658-a974164dcd86 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 200 len: 1371 microversion: 2.20 time: 0.100857 May 26 19:44:48.602578 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 399/786] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:48 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 19:44:48.781093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-91f167a6-a2dd-4e21-b7ac-ad9dc3d1f355 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:48.781745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-91f167a6-a2dd-4e21-b7ac-ad9dc3d1f355 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:48.788374 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-91f167a6-a2dd-4e21-b7ac-ad9dc3d1f355 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:48.795524 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-91f167a6-a2dd-4e21-b7ac-ad9dc3d1f355 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:48.795524 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-91f167a6-a2dd-4e21-b7ac-ad9dc3d1f355 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:48.795524 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-91f167a6-a2dd-4e21-b7ac-ad9dc3d1f355 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:48.919710 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-91f167a6-a2dd-4e21-b7ac-ad9dc3d1f355 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:48.927710 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-91f167a6-a2dd-4e21-b7ac-ad9dc3d1f355 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.150535 May 26 19:44:48.928285 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 388/787] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:48 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:49.625785 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:49.627165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:49.633390 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:49.633844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:49.637754 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:49.637754 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:49.651026 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] HTTP exception thrown: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Request method failure captured: May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 HTTP/1.1 May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9cvDxXfX5L2zD_VUvGVpwou4YkS7djzOnTmsiFcpoj4tojRi4CvjbSylhvw8nwtiTTiBOH43cISDHd_Fy9qAYo6PkaoznXuDJfrUiNp_jmeEcisuhQwDQkydRS3eKVeZXUxtWag-dDTAir5etCW5Gqj1gkVibjMzejUtg_BIUcF_8w May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Openstack-Nova-Api-Version: 2.20 May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:44:49.652712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b189404964f64aa88af37e536c1c7464", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b189404964f64aa88af37e536c1c7464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: a1327d80a17743daa137acaad895cd51 May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:49.654407 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '7d37e4a7-2599-4466-b249-a142cf7770f0'} May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:49.659172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:49.660747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:49.662100 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Returning 404 to user: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:49.662100 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3b26c425-a089-4a8a-aa53-7912c2c3aec6 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 404 len: 111 microversion: 2.20 time: 0.033082 May 26 19:44:49.662100 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 400/788] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:49 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 19:44:49.663899 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-65dddeef-428f-4aba-8ba4-d92b529da284 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '.version_select at 0x7fa788184160>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:49.667221 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-65dddeef-428f-4aba-8ba4-d92b529da284 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [63184afb-d5ea-4879-96a3-fb56a0c35607] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 19:44:49.948681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-517c37d3-b3a5-48ae-9e33-ffdea0e9dc52 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:49.948681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-517c37d3-b3a5-48ae-9e33-ffdea0e9dc52 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:49.951564 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-517c37d3-b3a5-48ae-9e33-ffdea0e9dc52 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:49.951884 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-517c37d3-b3a5-48ae-9e33-ffdea0e9dc52 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:49.952681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-517c37d3-b3a5-48ae-9e33-ffdea0e9dc52 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:49.953165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-517c37d3-b3a5-48ae-9e33-ffdea0e9dc52 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:50.321258 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-517c37d3-b3a5-48ae-9e33-ffdea0e9dc52 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:50.333893 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-517c37d3-b3a5-48ae-9e33-ffdea0e9dc52 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.388209 May 26 19:44:50.333893 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 401/789] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:49 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:50.675719 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO oslo.messaging._drivers.impl_rabbit [None req-65dddeef-428f-4aba-8ba4-d92b529da284 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [63184afb-d5ea-4879-96a3-fb56a0c35607] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 53980. May 26 19:44:50.750984 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-65dddeef-428f-4aba-8ba4-d92b529da284 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-607719719" status: 204 len: 0 microversion: 2.20 time: 1.091617 May 26 19:44:50.751880 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 389/790] 10.222.0.72 () {60 vars in 1258 bytes} [Thu May 26 19:44:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-607719719 => generated 0 bytes in 1093 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 19:44:51.345581 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e8d25e3a-d617-476a-aa49-a66be41afa37 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:51.346191 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e8d25e3a-d617-476a-aa49-a66be41afa37 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:51.357014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e8d25e3a-d617-476a-aa49-a66be41afa37 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:51.357014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e8d25e3a-d617-476a-aa49-a66be41afa37 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:51.357014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e8d25e3a-d617-476a-aa49-a66be41afa37 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:51.357014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e8d25e3a-d617-476a-aa49-a66be41afa37 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:51.565829 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e8d25e3a-d617-476a-aa49-a66be41afa37 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:51.575554 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e8d25e3a-d617-476a-aa49-a66be41afa37 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.233893 May 26 19:44:51.578374 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 402/791] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:51 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:52.596592 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-765d029b-3ea1-45d2-934a-d8cbe289b636 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:52.597244 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-765d029b-3ea1-45d2-934a-d8cbe289b636 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:52.604049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-765d029b-3ea1-45d2-934a-d8cbe289b636 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:52.608322 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-765d029b-3ea1-45d2-934a-d8cbe289b636 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:52.608322 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-765d029b-3ea1-45d2-934a-d8cbe289b636 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:52.608322 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-765d029b-3ea1-45d2-934a-d8cbe289b636 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:52.742996 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-765d029b-3ea1-45d2-934a-d8cbe289b636 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:52.751390 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-765d029b-3ea1-45d2-934a-d8cbe289b636 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.159899 May 26 19:44:52.751954 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 390/792] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:52 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:52.918263 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:52.925883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:52.925883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:52.926340 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:52.927136 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:52.927575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:52.944411 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] HTTP exception thrown: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Request method failure captured: May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 HTTP/1.1 May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9cvDxXfX5L2zD_VUvGVpwou4YkS7djzOnTmsiFcpoj4tojRi4CvjbSylhvw8nwtiTTiBOH43cISDHd_Fy9qAYo6PkaoznXuDJfrUiNp_jmeEcisuhQwDQkydRS3eKVeZXUxtWag-dDTAir5etCW5Gqj1gkVibjMzejUtg_BIUcF_8w May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Openstack-Nova-Api-Version: 2.20 May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:44:52.946185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b189404964f64aa88af37e536c1c7464", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b189404964f64aa88af37e536c1c7464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: a1327d80a17743daa137acaad895cd51 May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.953943 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '7d37e4a7-2599-4466-b249-a142cf7770f0'} May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:52.954838 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.956395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:52.957797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Returning 404 to user: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:52.957797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-eaa790d9-97a9-471b-98f0-17ae38c22a25 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 404 len: 111 microversion: 2.20 time: 0.033615 May 26 19:44:52.957797 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 403/793] 10.222.0.72 () {60 vars in 1279 bytes} [Thu May 26 19:44:52 2022] DELETE /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 19:44:52.957993 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:52.957993 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 7d37e4a7-2599-4466-b249-a142cf7770f0] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:52.964114 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:52.964569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:52.965349 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:52.965825 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:52.980358 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] HTTP exception thrown: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Request method failure captured: May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 HTTP/1.1 May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9cvDxXfX5L2zD_VUvGVpwou4YkS7djzOnTmsiFcpoj4tojRi4CvjbSylhvw8nwtiTTiBOH43cISDHd_Fy9qAYo6PkaoznXuDJfrUiNp_jmeEcisuhQwDQkydRS3eKVeZXUxtWag-dDTAir5etCW5Gqj1gkVibjMzejUtg_BIUcF_8w May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Openstack-Nova-Api-Version: 2.20 May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:44:52.982027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b189404964f64aa88af37e536c1c7464", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b189404964f64aa88af37e536c1c7464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: a1327d80a17743daa137acaad895cd51 May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.983539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '7d37e4a7-2599-4466-b249-a142cf7770f0'} May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:52.984274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. May 26 19:44:52.985516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:52.986681 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Returning 404 to user: Instance 7d37e4a7-2599-4466-b249-a142cf7770f0 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:52.986681 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e0671d98-83ac-4d58-8f5c-d72f373ec1a5 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0" status: 404 len: 111 microversion: 2.20 time: 0.031288 May 26 19:44:52.986681 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 391/794] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:52 2022] GET /compute/v2.1/servers/7d37e4a7-2599-4466-b249-a142cf7770f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 19:44:53.152451 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1882542155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1830455866", "security_groups": [{"name": "tempest-secgroup-smoke-1989480405"}], "block_device_mapping_v2": [{"uuid": "f24a2d9d-201b-4749-b76e-a79f8c44bcde", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "492a2884-9243-465b-939b-ac60c35b4b3f"}]}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:44:53.276287 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] validate_networks() for [('492a2884-9243-465b-939b-ac60c35b4b3f', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:44:53.652221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:44:53.652652 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:44:53.653165 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:44:53.653572 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:44:53.654005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:44:53.663545 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:53.664012 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:53.664823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:53.665261 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:53.684930 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Getting quotas for project dabc38fc95184250b1d9e7090ab73b2c. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:44:53.690195 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Getting quotas for user fe347ddb98df4018b1b9d65db314d8d8 and project dabc38fc95184250b1d9e7090ab73b2c. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:44:53.749661 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:44:53.752120 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f24a2d9d-201b-4749-b76e-a79f8c44bcde',volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:44:53.768196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a01f2793-fc77-4156-8afd-b51d7398b919 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:53.768790 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a01f2793-fc77-4156-8afd-b51d7398b919 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:53.775885 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a01f2793-fc77-4156-8afd-b51d7398b919 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:53.776452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a01f2793-fc77-4156-8afd-b51d7398b919 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:53.777307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a01f2793-fc77-4156-8afd-b51d7398b919 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:53.777873 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a01f2793-fc77-4156-8afd-b51d7398b919 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:53.915306 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a01f2793-fc77-4156-8afd-b51d7398b919 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:53.928614 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a01f2793-fc77-4156-8afd-b51d7398b919 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.164828 May 26 19:44:53.929372 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 392/795] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:53 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:44:54.159193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8592cc70-876d-420a-ac06-e695e8a93ee1 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.010605 May 26 19:44:54.164339 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 404/796] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:44:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:44:54.170143 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-50be1d81-5372-467f-a9df-adf8db11cf81 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:54.171082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-50be1d81-5372-467f-a9df-adf8db11cf81 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:54.238607 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-50be1d81-5372-467f-a9df-adf8db11cf81 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:54.245563 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-50be1d81-5372-467f-a9df-adf8db11cf81 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1095 microversion: 2.1 time: 0.079370 May 26 19:44:54.256075 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 393/797] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:54 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:54.265378 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:54.265378 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:54.271482 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:54.271937 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:54.273085 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:54.273210 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:54.286458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] HTTP exception thrown: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Request method failure captured: May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 HTTP/1.1 May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9cvDxXfX5L2zD_VUvGVpwou4YkS7djzOnTmsiFcpoj4tojRi4CvjbSylhvw8nwtiTTiBOH43cISDHd_Fy9qAYo6PkaoznXuDJfrUiNp_jmeEcisuhQwDQkydRS3eKVeZXUxtWag-dDTAir5etCW5Gqj1gkVibjMzejUtg_BIUcF_8w May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Openstack-Nova-Api-Version: 2.20 May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:44:54.288066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b189404964f64aa88af37e536c1c7464", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b189404964f64aa88af37e536c1c7464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: a1327d80a17743daa137acaad895cd51 May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.289686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '915b2746-efa1-4bc1-897f-dd3382e94a03'} May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:54.290747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.292773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:44:54.294306 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Returning 404 to user: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:54.294306 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9cbda11c-a6b0-4c2d-b173-48b8e7f92139 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "DELETE /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 404 len: 111 microversion: 2.20 time: 0.030761 May 26 19:44:54.294306 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 405/798] 10.222.0.72 () {60 vars in 1279 bytes} [Thu May 26 19:44:54 2022] DELETE /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 19:44:54.299785 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:54.305391 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] [instance: 915b2746-efa1-4bc1-897f-dd3382e94a03] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:54.307009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:54.307621 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:54.308483 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:54.309021 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:54.325300 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] HTTP exception thrown: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Request method failure captured: May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 HTTP/1.1 May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9cvDxXfX5L2zD_VUvGVpwou4YkS7djzOnTmsiFcpoj4tojRi4CvjbSylhvw8nwtiTTiBOH43cISDHd_Fy9qAYo6PkaoznXuDJfrUiNp_jmeEcisuhQwDQkydRS3eKVeZXUxtWag-dDTAir5etCW5Gqj1gkVibjMzejUtg_BIUcF_8w May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Openstack-Nova-Api-Version: 2.20 May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:44:54.326852 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b189404964f64aa88af37e536c1c7464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b189404964f64aa88af37e536c1c7464", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b189404964f64aa88af37e536c1c7464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: b189404964f64aa88af37e536c1c7464 May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1891182257 May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: a1327d80a17743daa137acaad895cd51 May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1891182257-project May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.329134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '915b2746-efa1-4bc1-897f-dd3382e94a03'} May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:44:54.329980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. May 26 19:44:54.331411 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:44:54.332715 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] Returning 404 to user: Instance 915b2746-efa1-4bc1-897f-dd3382e94a03 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:44:54.332715 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-721a4d7e-c31d-47ab-b5cf-17adbd983e95 tempest-AttachVolumeShelveTestJSON-1891182257 tempest-AttachVolumeShelveTestJSON-1891182257-project] 10.222.0.72 "GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03" status: 404 len: 111 microversion: 2.20 time: 0.032408 May 26 19:44:54.332715 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 394/799] 10.222.0.72 () {60 vars in 1276 bytes} [Thu May 26 19:44:54 2022] GET /compute/v2.1/servers/915b2746-efa1-4bc1-897f-dd3382e94a03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 19:44:54.945494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f775d8c9-0e44-4fcd-8594-a6b19f9ab185 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:54.946101 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f775d8c9-0e44-4fcd-8594-a6b19f9ab185 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:54.952561 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f775d8c9-0e44-4fcd-8594-a6b19f9ab185 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:54.953006 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f775d8c9-0e44-4fcd-8594-a6b19f9ab185 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:54.953763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f775d8c9-0e44-4fcd-8594-a6b19f9ab185 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:54.954195 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f775d8c9-0e44-4fcd-8594-a6b19f9ab185 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:55.160490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f775d8c9-0e44-4fcd-8594-a6b19f9ab185 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:55.168261 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f775d8c9-0e44-4fcd-8594-a6b19f9ab185 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.226597 May 26 19:44:55.168930 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 406/800] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:54 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:55.263048 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f56f401e-987c-4794-bcb1-3823289084f5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:55.263657 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f56f401e-987c-4794-bcb1-3823289084f5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:55.270891 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f56f401e-987c-4794-bcb1-3823289084f5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:55.274345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f56f401e-987c-4794-bcb1-3823289084f5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:55.274345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f56f401e-987c-4794-bcb1-3823289084f5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:55.274345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f56f401e-987c-4794-bcb1-3823289084f5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:55.340744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f56f401e-987c-4794-bcb1-3823289084f5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:55.350607 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f56f401e-987c-4794-bcb1-3823289084f5 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1145 microversion: 2.1 time: 0.091253 May 26 19:44:55.358820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 395/801] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:55 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:56.191046 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-18d6200f-09f8-451b-ad38-d2ec5b93d843 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:56.193343 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-18d6200f-09f8-451b-ad38-d2ec5b93d843 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:56.215069 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-18d6200f-09f8-451b-ad38-d2ec5b93d843 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:56.215958 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-18d6200f-09f8-451b-ad38-d2ec5b93d843 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:56.216972 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-18d6200f-09f8-451b-ad38-d2ec5b93d843 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:56.220659 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-18d6200f-09f8-451b-ad38-d2ec5b93d843 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:56.376251 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4741a5eb-5a11-43df-a635-a3457157cefd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:56.383075 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4741a5eb-5a11-43df-a635-a3457157cefd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:56.391834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4741a5eb-5a11-43df-a635-a3457157cefd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:56.392472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4741a5eb-5a11-43df-a635-a3457157cefd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:56.393491 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4741a5eb-5a11-43df-a635-a3457157cefd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:56.394089 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4741a5eb-5a11-43df-a635-a3457157cefd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:56.608662 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-18d6200f-09f8-451b-ad38-d2ec5b93d843 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:56.632476 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-18d6200f-09f8-451b-ad38-d2ec5b93d843 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.449829 May 26 19:44:56.633083 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 407/802] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:56 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:56.694030 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4741a5eb-5a11-43df-a635-a3457157cefd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:56.703330 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4741a5eb-5a11-43df-a635-a3457157cefd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1211 microversion: 2.1 time: 0.330996 May 26 19:44:56.705101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 396/803] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:56 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1211 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:57.650627 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e1769e73-046f-4b4c-9837-08d0b92f1ff3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:57.651377 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e1769e73-046f-4b4c-9837-08d0b92f1ff3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:57.661896 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e1769e73-046f-4b4c-9837-08d0b92f1ff3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:57.662450 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e1769e73-046f-4b4c-9837-08d0b92f1ff3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:57.664137 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e1769e73-046f-4b4c-9837-08d0b92f1ff3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:57.664590 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e1769e73-046f-4b4c-9837-08d0b92f1ff3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:57.722340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-26aa53c1-8799-4446-b472-ca3fac76987d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:57.722340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-26aa53c1-8799-4446-b472-ca3fac76987d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:57.741918 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-26aa53c1-8799-4446-b472-ca3fac76987d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:57.742383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-26aa53c1-8799-4446-b472-ca3fac76987d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:57.743203 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-26aa53c1-8799-4446-b472-ca3fac76987d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:57.743653 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-26aa53c1-8799-4446-b472-ca3fac76987d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:57.925389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e1769e73-046f-4b4c-9837-08d0b92f1ff3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:57.943698 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e1769e73-046f-4b4c-9837-08d0b92f1ff3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1678 microversion: 2.1 time: 0.297900 May 26 19:44:57.944520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 408/804] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:57 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1678 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:58.535107 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-26aa53c1-8799-4446-b472-ca3fac76987d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:58.544667 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-26aa53c1-8799-4446-b472-ca3fac76987d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1279 microversion: 2.1 time: 0.826306 May 26 19:44:58.554382 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 397/805] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:57 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1279 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:58.961332 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5a80bb77-7b09-4170-9c39-643be2c30683 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:58.962012 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5a80bb77-7b09-4170-9c39-643be2c30683 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:58.972833 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5a80bb77-7b09-4170-9c39-643be2c30683 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:58.973289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5a80bb77-7b09-4170-9c39-643be2c30683 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:58.974074 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5a80bb77-7b09-4170-9c39-643be2c30683 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:58.974515 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5a80bb77-7b09-4170-9c39-643be2c30683 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:59.036715 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:59.256477 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-39814586-a09d-4072-8e0a-3700ca267240 req-29c0d383-9015-4b2b-a05b-eae39932359b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b866a8-96fd-4c60-ac2c-9fbaf249c843", "tag": "5ecc06c8-c98f-447b-9a1b-988dbfb4aa53"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:44:59.281323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-39814586-a09d-4072-8e0a-3700ca267240 req-29c0d383-9015-4b2b-a05b-eae39932359b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:59.282045 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-39814586-a09d-4072-8e0a-3700ca267240 req-29c0d383-9015-4b2b-a05b-eae39932359b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:59.312321 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5a80bb77-7b09-4170-9c39-643be2c30683 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:59.317361 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-39814586-a09d-4072-8e0a-3700ca267240 req-29c0d383-9015-4b2b-a05b-eae39932359b service nova] Creating event network-changed:5ecc06c8-c98f-447b-9a1b-988dbfb4aa53 for instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 on hv-cinder-82549 May 26 19:44:59.323516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-39814586-a09d-4072-8e0a-3700ca267240 req-29c0d383-9015-4b2b-a05b-eae39932359b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071561 May 26 19:44:59.324206 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5a80bb77-7b09-4170-9c39-643be2c30683 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1655 microversion: 2.1 time: 0.366880 May 26 19:44:59.325069 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 398/806] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:44:59.326020 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 409/807] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:58 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1655 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:44:59.347958 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-240d4e35-a6ad-4517-a648-19a24f0503b3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:44:59.370820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-240d4e35-a6ad-4517-a648-19a24f0503b3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:59.371744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-240d4e35-a6ad-4517-a648-19a24f0503b3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:59.407252 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-240d4e35-a6ad-4517-a648-19a24f0503b3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Going to try to start instance {{(pid=124877) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 19:44:59.562080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-67c673d8-904d-447d-94bf-75910a427ca9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:59.562687 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-67c673d8-904d-447d-94bf-75910a427ca9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:59.569629 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-67c673d8-904d-447d-94bf-75910a427ca9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:59.570078 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-67c673d8-904d-447d-94bf-75910a427ca9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:59.570848 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-67c673d8-904d-447d-94bf-75910a427ca9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:59.571308 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-67c673d8-904d-447d-94bf-75910a427ca9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:59.679819 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-240d4e35-a6ad-4517-a648-19a24f0503b3 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/action" status: 202 len: 0 microversion: 2.1 time: 0.340455 May 26 19:44:59.680796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 399/808] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:44:59 2022] POST /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:44:59.690717 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ec760b2f-4f9d-430b-b276-7463643b444a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:44:59.692396 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ec760b2f-4f9d-430b-b276-7463643b444a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:44:59.700748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ec760b2f-4f9d-430b-b276-7463643b444a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:59.701625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ec760b2f-4f9d-430b-b276-7463643b444a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:59.702754 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ec760b2f-4f9d-430b-b276-7463643b444a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:44:59.703415 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ec760b2f-4f9d-430b-b276-7463643b444a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:44:59.765439 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-67c673d8-904d-447d-94bf-75910a427ca9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:44:59.774168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-67c673d8-904d-447d-94bf-75910a427ca9 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.216006 May 26 19:44:59.777023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 410/809] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:59 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:00.139373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ec760b2f-4f9d-430b-b276-7463643b444a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:00.170931 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ec760b2f-4f9d-430b-b276-7463643b444a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1664 microversion: 2.1 time: 0.484869 May 26 19:45:00.173225 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 400/810] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:44:59 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1664 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:00.793182 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-634d1ea3-d6c3-4042-81a9-846ce1815364 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:00.794718 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-634d1ea3-d6c3-4042-81a9-846ce1815364 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:00.805607 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-634d1ea3-d6c3-4042-81a9-846ce1815364 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:00.806046 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-634d1ea3-d6c3-4042-81a9-846ce1815364 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:00.806827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-634d1ea3-d6c3-4042-81a9-846ce1815364 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:00.807370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-634d1ea3-d6c3-4042-81a9-846ce1815364 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:00.982562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-634d1ea3-d6c3-4042-81a9-846ce1815364 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:00.991040 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-634d1ea3-d6c3-4042-81a9-846ce1815364 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.201769 May 26 19:45:00.992093 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 411/811] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:00 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:01.191471 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-cd444980-2c70-4f9a-adf7-2b52492db307 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:01.192694 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-cd444980-2c70-4f9a-adf7-2b52492db307 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:01.199654 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cd444980-2c70-4f9a-adf7-2b52492db307 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:01.200327 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cd444980-2c70-4f9a-adf7-2b52492db307 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:01.202130 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cd444980-2c70-4f9a-adf7-2b52492db307 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:01.202725 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cd444980-2c70-4f9a-adf7-2b52492db307 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:01.212095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:01.467960 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-cd444980-2c70-4f9a-adf7-2b52492db307 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:01.475932 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-cd444980-2c70-4f9a-adf7-2b52492db307 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1664 microversion: 2.1 time: 0.288849 May 26 19:45:01.476662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 401/812] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:01 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1664 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:45:02.009551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3346d2a0-4351-4a41-85ef-9f061beec011 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:02.010275 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3346d2a0-4351-4a41-85ef-9f061beec011 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:02.017436 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3346d2a0-4351-4a41-85ef-9f061beec011 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:02.018127 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3346d2a0-4351-4a41-85ef-9f061beec011 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:02.018878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3346d2a0-4351-4a41-85ef-9f061beec011 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:02.019418 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3346d2a0-4351-4a41-85ef-9f061beec011 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:02.154409 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3346d2a0-4351-4a41-85ef-9f061beec011 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:02.162762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3346d2a0-4351-4a41-85ef-9f061beec011 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.157563 May 26 19:45:02.163389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 412/813] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:02 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:02.494523 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6b5c8625-5aeb-4ec6-a2b7-f7521713a114 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:02.495158 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6b5c8625-5aeb-4ec6-a2b7-f7521713a114 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:02.503611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b5c8625-5aeb-4ec6-a2b7-f7521713a114 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:02.504053 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b5c8625-5aeb-4ec6-a2b7-f7521713a114 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:02.504813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b5c8625-5aeb-4ec6-a2b7-f7521713a114 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:02.505249 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6b5c8625-5aeb-4ec6-a2b7-f7521713a114 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:02.650274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6b5c8625-5aeb-4ec6-a2b7-f7521713a114 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:02.657758 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6b5c8625-5aeb-4ec6-a2b7-f7521713a114 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1668 microversion: 2.1 time: 0.167986 May 26 19:45:02.658330 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 402/814] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:02 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:45:03.032193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1716793263", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "networks": [{"uuid": "34f3a739-7e78-433b-8a6a-0d4643be2b0c"}]}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:45:03.085453 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] validate_networks() for [('34f3a739-7e78-433b-8a6a-0d4643be2b0c', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:45:03.180859 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7d1b35d0-bc37-4291-a880-a4ba9f750025 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:03.181700 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7d1b35d0-bc37-4291-a880-a4ba9f750025 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:03.188623 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7d1b35d0-bc37-4291-a880-a4ba9f750025 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:03.189012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7d1b35d0-bc37-4291-a880-a4ba9f750025 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:03.189921 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7d1b35d0-bc37-4291-a880-a4ba9f750025 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:03.190750 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7d1b35d0-bc37-4291-a880-a4ba9f750025 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:03.362504 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7d1b35d0-bc37-4291-a880-a4ba9f750025 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:03.372730 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7d1b35d0-bc37-4291-a880-a4ba9f750025 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.196724 May 26 19:45:03.373314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 403/815] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:03 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:45:03.460961 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:45:03.461434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:45:03.461927 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:45:03.462333 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:45:03.462739 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:45:03.472033 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:03.472572 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:03.473368 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:03.473804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:03.490682 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Getting quotas for project e99682e050fe48ca82cbecebe920a6f9. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:45:03.496780 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Getting quotas for user d38941f7008944e38832411e85316a98 and project e99682e050fe48ca82cbecebe920a6f9. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:45:03.505977 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:45:03.508154 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:45:03.643341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-71acb126-287e-4f2a-81c4-6ccef2980312 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614857 May 26 19:45:03.644028 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 413/816] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:45:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:45:03.654241 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-93bbc7cd-d26b-4c27-bc87-4853a1ba5e9d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:03.654850 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-93bbc7cd-d26b-4c27-bc87-4853a1ba5e9d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:03.748124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-93bbc7cd-d26b-4c27-bc87-4853a1ba5e9d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:03.755591 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-93bbc7cd-d26b-4c27-bc87-4853a1ba5e9d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1219 microversion: 2.1 time: 0.105370 May 26 19:45:03.756353 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 404/817] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:03 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:04.393558 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9360a990-893b-4e9a-98f7-839a324b243b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:04.394762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9360a990-893b-4e9a-98f7-839a324b243b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:04.403390 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9360a990-893b-4e9a-98f7-839a324b243b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:04.404116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9360a990-893b-4e9a-98f7-839a324b243b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:04.405204 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9360a990-893b-4e9a-98f7-839a324b243b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:04.405880 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9360a990-893b-4e9a-98f7-839a324b243b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:04.544379 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9360a990-893b-4e9a-98f7-839a324b243b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:04.551964 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9360a990-893b-4e9a-98f7-839a324b243b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.166119 May 26 19:45:04.552602 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 414/818] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:04 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:04.772642 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2ecf12bf-d25b-44ea-a52c-963e66920cfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:04.773278 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2ecf12bf-d25b-44ea-a52c-963e66920cfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:04.780458 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ecf12bf-d25b-44ea-a52c-963e66920cfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:04.780904 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ecf12bf-d25b-44ea-a52c-963e66920cfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:04.782174 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ecf12bf-d25b-44ea-a52c-963e66920cfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:04.782611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ecf12bf-d25b-44ea-a52c-963e66920cfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:04.842287 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2ecf12bf-d25b-44ea-a52c-963e66920cfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:04.850226 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2ecf12bf-d25b-44ea-a52c-963e66920cfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1223 microversion: 2.1 time: 0.081438 May 26 19:45:04.850796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 405/819] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:04 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:05.569416 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8d4569b6-2070-416d-ad11-dc3f7da51d02 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:05.570118 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8d4569b6-2070-416d-ad11-dc3f7da51d02 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:05.576832 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8d4569b6-2070-416d-ad11-dc3f7da51d02 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:05.577232 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8d4569b6-2070-416d-ad11-dc3f7da51d02 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:05.577997 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8d4569b6-2070-416d-ad11-dc3f7da51d02 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:05.578439 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8d4569b6-2070-416d-ad11-dc3f7da51d02 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:05.719902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8d4569b6-2070-416d-ad11-dc3f7da51d02 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:05.727516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8d4569b6-2070-416d-ad11-dc3f7da51d02 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.162008 May 26 19:45:05.728090 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 415/820] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:05 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:05.867170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5fb311f5-73c1-4afb-8943-37c8277a84b3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:05.867776 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5fb311f5-73c1-4afb-8943-37c8277a84b3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:05.874409 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5fb311f5-73c1-4afb-8943-37c8277a84b3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:05.874856 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5fb311f5-73c1-4afb-8943-37c8277a84b3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:05.876179 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5fb311f5-73c1-4afb-8943-37c8277a84b3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:05.876613 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5fb311f5-73c1-4afb-8943-37c8277a84b3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:05.935807 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5fb311f5-73c1-4afb-8943-37c8277a84b3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:05.943792 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5fb311f5-73c1-4afb-8943-37c8277a84b3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1279 microversion: 2.1 time: 0.080584 May 26 19:45:05.944531 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 406/821] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:05 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1279 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:06.744713 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f57b0745-ca1b-42e1-8a73-714bc9ee0547 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:06.745990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f57b0745-ca1b-42e1-8a73-714bc9ee0547 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:06.752680 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f57b0745-ca1b-42e1-8a73-714bc9ee0547 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:06.753133 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f57b0745-ca1b-42e1-8a73-714bc9ee0547 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:06.753894 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f57b0745-ca1b-42e1-8a73-714bc9ee0547 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:06.754510 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f57b0745-ca1b-42e1-8a73-714bc9ee0547 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:06.897476 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f57b0745-ca1b-42e1-8a73-714bc9ee0547 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:06.904988 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f57b0745-ca1b-42e1-8a73-714bc9ee0547 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.164595 May 26 19:45:06.905548 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 416/822] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:06 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:06.961720 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-11038fe1-ea8c-45b0-a6d9-27301900f943 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:06.962345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-11038fe1-ea8c-45b0-a6d9-27301900f943 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:06.969236 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-11038fe1-ea8c-45b0-a6d9-27301900f943 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:06.971782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-11038fe1-ea8c-45b0-a6d9-27301900f943 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:06.971782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-11038fe1-ea8c-45b0-a6d9-27301900f943 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:06.971782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-11038fe1-ea8c-45b0-a6d9-27301900f943 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:07.116840 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-11038fe1-ea8c-45b0-a6d9-27301900f943 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:07.124673 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-11038fe1-ea8c-45b0-a6d9-27301900f943 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1319 microversion: 2.1 time: 0.167789 May 26 19:45:07.125231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 407/823] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:06 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:07.926842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6268eee5-855f-4e4a-8b7c-f02341819f9b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:07.926842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6268eee5-855f-4e4a-8b7c-f02341819f9b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:07.934892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6268eee5-855f-4e4a-8b7c-f02341819f9b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:07.935506 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6268eee5-855f-4e4a-8b7c-f02341819f9b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:07.936278 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6268eee5-855f-4e4a-8b7c-f02341819f9b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:07.936751 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6268eee5-855f-4e4a-8b7c-f02341819f9b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:07.984172 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-1a71c449-d42e-448c-99e6-634006391e78 req-41d51d7f-e939-45ce-ab71-94ca970bc838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f078ae03-f894-4a29-b0a5-6b1d00cc424d", "tag": "6fe129fb-f583-4c5e-a15c-855a8b053449"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:45:07.996825 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-1a71c449-d42e-448c-99e6-634006391e78 req-41d51d7f-e939-45ce-ab71-94ca970bc838 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:07.997280 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-1a71c449-d42e-448c-99e6-634006391e78 req-41d51d7f-e939-45ce-ab71-94ca970bc838 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:08.008647 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-1a71c449-d42e-448c-99e6-634006391e78 req-41d51d7f-e939-45ce-ab71-94ca970bc838 service nova] Creating event network-changed:6fe129fb-f583-4c5e-a15c-855a8b053449 for instance f078ae03-f894-4a29-b0a5-6b1d00cc424d on hv-cinder-82549 May 26 19:45:08.013521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-1a71c449-d42e-448c-99e6-634006391e78 req-41d51d7f-e939-45ce-ab71-94ca970bc838 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033193 May 26 19:45:08.014390 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 408/824] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:45:08.089921 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6268eee5-855f-4e4a-8b7c-f02341819f9b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:08.099011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6268eee5-855f-4e4a-8b7c-f02341819f9b tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.181158 May 26 19:45:08.099592 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 417/825] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:07 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:08.142978 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1d94691b-acad-45fb-8848-8a3a1d39d80c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:08.143695 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1d94691b-acad-45fb-8848-8a3a1d39d80c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:08.150133 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d94691b-acad-45fb-8848-8a3a1d39d80c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:08.150595 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d94691b-acad-45fb-8848-8a3a1d39d80c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:08.151460 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d94691b-acad-45fb-8848-8a3a1d39d80c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:08.151899 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d94691b-acad-45fb-8848-8a3a1d39d80c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:08.627091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1d94691b-acad-45fb-8848-8a3a1d39d80c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:08.634818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1d94691b-acad-45fb-8848-8a3a1d39d80c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1319 microversion: 2.1 time: 0.496655 May 26 19:45:08.635437 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 409/826] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:08 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:45:09.124499 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d55ba89f-4588-4e0f-aa7a-6f5731ded443 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:09.125183 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d55ba89f-4588-4e0f-aa7a-6f5731ded443 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:09.132433 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d55ba89f-4588-4e0f-aa7a-6f5731ded443 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:09.132894 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d55ba89f-4588-4e0f-aa7a-6f5731ded443 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:09.133667 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d55ba89f-4588-4e0f-aa7a-6f5731ded443 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:09.134105 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d55ba89f-4588-4e0f-aa7a-6f5731ded443 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:09.274001 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d55ba89f-4588-4e0f-aa7a-6f5731ded443 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:09.282801 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d55ba89f-4588-4e0f-aa7a-6f5731ded443 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.162196 May 26 19:45:09.283662 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 418/827] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:09 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:09.380999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-b3df303a-8e76-4a70-a7af-2ba4282e6a15 req-9bcc130d-6f72-4e96-80c2-1e458d86bc4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b866a8-96fd-4c60-ac2c-9fbaf249c843", "name": "network-vif-plugged", "status": "completed", "tag": "5ecc06c8-c98f-447b-9a1b-988dbfb4aa53"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:45:09.389981 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-b3df303a-8e76-4a70-a7af-2ba4282e6a15 req-9bcc130d-6f72-4e96-80c2-1e458d86bc4a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:09.390426 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-b3df303a-8e76-4a70-a7af-2ba4282e6a15 req-9bcc130d-6f72-4e96-80c2-1e458d86bc4a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:09.401098 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-b3df303a-8e76-4a70-a7af-2ba4282e6a15 req-9bcc130d-6f72-4e96-80c2-1e458d86bc4a service nova] Creating event network-vif-plugged:5ecc06c8-c98f-447b-9a1b-988dbfb4aa53 for instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 on hv-cinder-82549 May 26 19:45:09.405959 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-b3df303a-8e76-4a70-a7af-2ba4282e6a15 req-9bcc130d-6f72-4e96-80c2-1e458d86bc4a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030002 May 26 19:45:09.407231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 410/828] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:45:09.652769 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e6a20592-7e73-402f-a14a-b0723d9115b6 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:09.653381 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e6a20592-7e73-402f-a14a-b0723d9115b6 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:09.660083 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6a20592-7e73-402f-a14a-b0723d9115b6 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:09.660475 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6a20592-7e73-402f-a14a-b0723d9115b6 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:09.661294 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6a20592-7e73-402f-a14a-b0723d9115b6 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:09.661732 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e6a20592-7e73-402f-a14a-b0723d9115b6 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:09.790251 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e6a20592-7e73-402f-a14a-b0723d9115b6 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:09.797663 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e6a20592-7e73-402f-a14a-b0723d9115b6 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1319 microversion: 2.1 time: 0.148905 May 26 19:45:09.798231 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 419/829] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:09 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:10.300449 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5f08b83c-cb5c-4fe9-bccf-14d22920aeca tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:10.301197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5f08b83c-cb5c-4fe9-bccf-14d22920aeca tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:10.307328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f08b83c-cb5c-4fe9-bccf-14d22920aeca tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:10.307804 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f08b83c-cb5c-4fe9-bccf-14d22920aeca tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:10.308569 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f08b83c-cb5c-4fe9-bccf-14d22920aeca tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:10.309003 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f08b83c-cb5c-4fe9-bccf-14d22920aeca tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:10.464493 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5f08b83c-cb5c-4fe9-bccf-14d22920aeca tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:10.471935 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5f08b83c-cb5c-4fe9-bccf-14d22920aeca tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.176330 May 26 19:45:10.472500 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 411/830] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:10 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:10.814467 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-50327777-d4a6-4c07-839d-409b364ff401 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:10.815102 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-50327777-d4a6-4c07-839d-409b364ff401 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:10.821852 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50327777-d4a6-4c07-839d-409b364ff401 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:10.822295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50327777-d4a6-4c07-839d-409b364ff401 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:10.823095 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50327777-d4a6-4c07-839d-409b364ff401 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:10.823581 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50327777-d4a6-4c07-839d-409b364ff401 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:10.955957 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-50327777-d4a6-4c07-839d-409b364ff401 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:10.963721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-50327777-d4a6-4c07-839d-409b364ff401 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1319 microversion: 2.1 time: 0.153297 May 26 19:45:10.964496 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 420/831] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:10 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:11.488506 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e88e96ac-2d23-43c1-bae7-0036e14b8933 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:11.489025 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e88e96ac-2d23-43c1-bae7-0036e14b8933 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:11.495533 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e88e96ac-2d23-43c1-bae7-0036e14b8933 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:11.496015 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e88e96ac-2d23-43c1-bae7-0036e14b8933 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:11.496768 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e88e96ac-2d23-43c1-bae7-0036e14b8933 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:11.497199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e88e96ac-2d23-43c1-bae7-0036e14b8933 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:11.631306 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e88e96ac-2d23-43c1-bae7-0036e14b8933 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:11.638886 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e88e96ac-2d23-43c1-bae7-0036e14b8933 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1267 microversion: 2.1 time: 0.154860 May 26 19:45:11.639477 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 412/832] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:11 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:11.980910 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8b9db25c-3b24-439c-886b-345a372b0ef3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:11.981518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8b9db25c-3b24-439c-886b-345a372b0ef3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:11.988693 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b9db25c-3b24-439c-886b-345a372b0ef3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:11.989136 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b9db25c-3b24-439c-886b-345a372b0ef3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:11.989890 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b9db25c-3b24-439c-886b-345a372b0ef3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:11.990323 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8b9db25c-3b24-439c-886b-345a372b0ef3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:12.124647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8b9db25c-3b24-439c-886b-345a372b0ef3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:12.132151 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8b9db25c-3b24-439c-886b-345a372b0ef3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1319 microversion: 2.1 time: 0.155138 May 26 19:45:12.132713 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 421/833] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:11 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:12.711343 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-44a3ce47-b269-4ff5-b2f6-d3a9ba26c44d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:12.711953 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-44a3ce47-b269-4ff5-b2f6-d3a9ba26c44d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:12.718466 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-44a3ce47-b269-4ff5-b2f6-d3a9ba26c44d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:12.718879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-44a3ce47-b269-4ff5-b2f6-d3a9ba26c44d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:12.719696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-44a3ce47-b269-4ff5-b2f6-d3a9ba26c44d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:12.720791 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-44a3ce47-b269-4ff5-b2f6-d3a9ba26c44d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:12.854793 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-44a3ce47-b269-4ff5-b2f6-d3a9ba26c44d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:12.862505 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-44a3ce47-b269-4ff5-b2f6-d3a9ba26c44d tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1455 microversion: 2.1 time: 0.155057 May 26 19:45:12.863099 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 413/834] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:12 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:12.879102 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e1e685de-5366-4bd0-a436-0e41ced9e0c2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:12.879747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e1e685de-5366-4bd0-a436-0e41ced9e0c2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:12.881695 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:12.886356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e1e685de-5366-4bd0-a436-0e41ced9e0c2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:12.886812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e1e685de-5366-4bd0-a436-0e41ced9e0c2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:12.887608 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e1e685de-5366-4bd0-a436-0e41ced9e0c2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:12.888054 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e1e685de-5366-4bd0-a436-0e41ced9e0c2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:13.018214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e1e685de-5366-4bd0-a436-0e41ced9e0c2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:13.025690 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e1e685de-5366-4bd0-a436-0e41ced9e0c2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1455 microversion: 2.1 time: 0.150955 May 26 19:45:13.026269 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 422/835] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:12 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:13.149300 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9eaf0604-8e5d-4a25-8dd1-c7eb5c9192a2 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:13.149932 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9eaf0604-8e5d-4a25-8dd1-c7eb5c9192a2 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:13.152449 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:13.157774 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9eaf0604-8e5d-4a25-8dd1-c7eb5c9192a2 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:13.159305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9eaf0604-8e5d-4a25-8dd1-c7eb5c9192a2 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:13.159305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9eaf0604-8e5d-4a25-8dd1-c7eb5c9192a2 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:13.160014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9eaf0604-8e5d-4a25-8dd1-c7eb5c9192a2 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:13.306939 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9eaf0604-8e5d-4a25-8dd1-c7eb5c9192a2 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:13.315684 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9eaf0604-8e5d-4a25-8dd1-c7eb5c9192a2 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1319 microversion: 2.1 time: 0.170144 May 26 19:45:13.325058 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 414/836] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:13 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:13.403932 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-791dc0ab-94a7-41c1-92a5-12d2596c7390 req-0b1eeae2-6d84-4e62-b2ed-e7e8d515711f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f078ae03-f894-4a29-b0a5-6b1d00cc424d", "name": "network-vif-plugged", "status": "completed", "tag": "6fe129fb-f583-4c5e-a15c-855a8b053449"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:45:13.415104 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-791dc0ab-94a7-41c1-92a5-12d2596c7390 req-0b1eeae2-6d84-4e62-b2ed-e7e8d515711f service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:13.415793 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-791dc0ab-94a7-41c1-92a5-12d2596c7390 req-0b1eeae2-6d84-4e62-b2ed-e7e8d515711f service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:13.428654 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-791dc0ab-94a7-41c1-92a5-12d2596c7390 req-0b1eeae2-6d84-4e62-b2ed-e7e8d515711f service nova] Creating event network-vif-plugged:6fe129fb-f583-4c5e-a15c-855a8b053449 for instance f078ae03-f894-4a29-b0a5-6b1d00cc424d on hv-cinder-82549 May 26 19:45:13.433905 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-791dc0ab-94a7-41c1-92a5-12d2596c7390 req-0b1eeae2-6d84-4e62-b2ed-e7e8d515711f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037024 May 26 19:45:13.434707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 423/837] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:45:14.332604 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a56e906d-cd1a-4bf4-8659-ff673ea80d60 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:14.333230 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a56e906d-cd1a-4bf4-8659-ff673ea80d60 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:14.335614 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=4 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:14.340423 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a56e906d-cd1a-4bf4-8659-ff673ea80d60 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:14.340882 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a56e906d-cd1a-4bf4-8659-ff673ea80d60 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:14.341653 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a56e906d-cd1a-4bf4-8659-ff673ea80d60 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:14.342094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a56e906d-cd1a-4bf4-8659-ff673ea80d60 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:14.495291 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a56e906d-cd1a-4bf4-8659-ff673ea80d60 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:14.503328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a56e906d-cd1a-4bf4-8659-ff673ea80d60 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1319 microversion: 2.1 time: 0.175115 May 26 19:45:14.503905 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 415/838] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:14 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:15.218180 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=4 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:15.219812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=12 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:15.225031 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-890bc5af-c653-4edd-b1ce-a2c6c852ccda req-d781c249-da47-44de-9e2b-48a1af6e31c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b866a8-96fd-4c60-ac2c-9fbaf249c843", "tag": "5ecc06c8-c98f-447b-9a1b-988dbfb4aa53"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:45:15.233691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-890bc5af-c653-4edd-b1ce-a2c6c852ccda req-d781c249-da47-44de-9e2b-48a1af6e31c1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:15.234125 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-890bc5af-c653-4edd-b1ce-a2c6c852ccda req-d781c249-da47-44de-9e2b-48a1af6e31c1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:15.247975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-890bc5af-c653-4edd-b1ce-a2c6c852ccda req-d781c249-da47-44de-9e2b-48a1af6e31c1 service nova] Creating event network-changed:5ecc06c8-c98f-447b-9a1b-988dbfb4aa53 for instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 on hv-cinder-82549 May 26 19:45:15.253808 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-890bc5af-c653-4edd-b1ce-a2c6c852ccda req-d781c249-da47-44de-9e2b-48a1af6e31c1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036161 May 26 19:45:15.254553 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 424/839] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:45:15.520563 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-568b683b-cc4f-4226-a21a-f932824f3b49 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:15.521696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-568b683b-cc4f-4226-a21a-f932824f3b49 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:15.532156 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-568b683b-cc4f-4226-a21a-f932824f3b49 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:15.532856 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-568b683b-cc4f-4226-a21a-f932824f3b49 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:15.534185 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-568b683b-cc4f-4226-a21a-f932824f3b49 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:15.534839 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-568b683b-cc4f-4226-a21a-f932824f3b49 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:15.760675 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-568b683b-cc4f-4226-a21a-f932824f3b49 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:15.768991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-568b683b-cc4f-4226-a21a-f932824f3b49 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1319 microversion: 2.1 time: 0.253036 May 26 19:45:15.770085 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 416/840] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:15 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:16.787226 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e217963a-1679-43e4-a924-521068e97637 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:45:16.789224 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e217963a-1679-43e4-a924-521068e97637 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:16.795285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e217963a-1679-43e4-a924-521068e97637 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:16.795733 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e217963a-1679-43e4-a924-521068e97637 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:16.796487 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e217963a-1679-43e4-a924-521068e97637 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:16.796917 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e217963a-1679-43e4-a924-521068e97637 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:16.925167 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e217963a-1679-43e4-a924-521068e97637 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:45:16.932691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e217963a-1679-43e4-a924-521068e97637 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1508 microversion: 2.1 time: 0.150827 May 26 19:45:16.933254 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 425/841] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:45:16 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:45:19.153574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:45:19.154158 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Thu May 26 19:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 19:45:36.581566 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5454b042-ce87-4c1d-affd-3843bb101c27 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b54ce05c-c436-497f-8b2c-43cbd53501b8", "device": "/dev/sdb"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:45:36.583669 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5454b042-ce87-4c1d-affd-3843bb101c27 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:45:36.586235 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=5 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:36.586976 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=80 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:36.592373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5454b042-ce87-4c1d-affd-3843bb101c27 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:36.592827 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5454b042-ce87-4c1d-affd-3843bb101c27 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:36.593587 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5454b042-ce87-4c1d-affd-3843bb101c27 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:45:36.594032 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5454b042-ce87-4c1d-affd-3843bb101c27 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:45:37.472846 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5454b042-ce87-4c1d-affd-3843bb101c27 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "POST /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895238 May 26 19:45:37.476469 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 417/842] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:45:36 2022] POST /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d/os-volume_attachments => generated 194 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:03.311291 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8af604f5-4327-4371-ae7f-561ab4cf9a1e tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:03.311837 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8af604f5-4327-4371-ae7f-561ab4cf9a1e tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:03.313801 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=7 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:03.314601 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=86 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:03.319425 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8af604f5-4327-4371-ae7f-561ab4cf9a1e tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:03.324953 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8af604f5-4327-4371-ae7f-561ab4cf9a1e tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:03.324953 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8af604f5-4327-4371-ae7f-561ab4cf9a1e tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:03.324953 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8af604f5-4327-4371-ae7f-561ab4cf9a1e tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:03.403568 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-8af604f5-4327-4371-ae7f-561ab4cf9a1e tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lazy-loading 'services' on Instance uuid f078ae03-f894-4a29-b0a5-6b1d00cc424d {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:46:03.655585 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8af604f5-4327-4371-ae7f-561ab4cf9a1e tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d/os-volume_attachments/b54ce05c-c436-497f-8b2c-43cbd53501b8" status: 202 len: 0 microversion: 2.1 time: 0.348284 May 26 19:46:03.656214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 426/843] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:46:03 2022] DELETE /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d/os-volume_attachments/b54ce05c-c436-497f-8b2c-43cbd53501b8 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:46:05.824195 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:05.825034 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:05.829084 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-06a875cc-d212-48e3-a986-ac28bcd431af tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:05.829661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-06a875cc-d212-48e3-a986-ac28bcd431af tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:05.835713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-06a875cc-d212-48e3-a986-ac28bcd431af tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:05.836162 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-06a875cc-d212-48e3-a986-ac28bcd431af tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:05.836920 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-06a875cc-d212-48e3-a986-ac28bcd431af tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:05.837354 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-06a875cc-d212-48e3-a986-ac28bcd431af tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:05.864142 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-06a875cc-d212-48e3-a986-ac28bcd431af tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:46:06.156006 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5e35144d-0667-45cf-9556-7dea68a8f91f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:06.157077 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5e35144d-0667-45cf-9556-7dea68a8f91f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:06.160525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-06a875cc-d212-48e3-a986-ac28bcd431af tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 204 len: 0 microversion: 2.1 time: 0.337547 May 26 19:46:06.161104 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 418/844] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:46:05 2022] DELETE /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:46:06.164872 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5e35144d-0667-45cf-9556-7dea68a8f91f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:06.165606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5e35144d-0667-45cf-9556-7dea68a8f91f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:06.171072 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5e35144d-0667-45cf-9556-7dea68a8f91f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:06.171072 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5e35144d-0667-45cf-9556-7dea68a8f91f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:06.171301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-caabed5a-317d-4392-96bd-15e8d3290c3d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:06.171301 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-caabed5a-317d-4392-96bd-15e8d3290c3d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:06.179472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-caabed5a-317d-4392-96bd-15e8d3290c3d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:06.180011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-caabed5a-317d-4392-96bd-15e8d3290c3d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:06.180950 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-caabed5a-317d-4392-96bd-15e8d3290c3d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:06.181567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-caabed5a-317d-4392-96bd-15e8d3290c3d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:06.202711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5e35144d-0667-45cf-9556-7dea68a8f91f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050794 May 26 19:46:06.202711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 427/845] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:46:06 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 19:46:06.266404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-229a8e48-8264-4109-aa3d-b04a54e35e30 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:06.267067 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-229a8e48-8264-4109-aa3d-b04a54e35e30 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:06.273197 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-229a8e48-8264-4109-aa3d-b04a54e35e30 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:06.274425 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-229a8e48-8264-4109-aa3d-b04a54e35e30 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:06.274425 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-229a8e48-8264-4109-aa3d-b04a54e35e30 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:06.275224 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-229a8e48-8264-4109-aa3d-b04a54e35e30 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:06.299698 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-229a8e48-8264-4109-aa3d-b04a54e35e30 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:46:06.325271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-caabed5a-317d-4392-96bd-15e8d3290c3d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:06.332962 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-caabed5a-317d-4392-96bd-15e8d3290c3d tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1514 microversion: 2.1 time: 0.167091 May 26 19:46:06.333467 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 419/846] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:06 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:06.594640 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-229a8e48-8264-4109-aa3d-b04a54e35e30 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 204 len: 0 microversion: 2.1 time: 0.331796 May 26 19:46:06.595284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 428/847] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:46:06 2022] DELETE /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 19:46:06.603345 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d8215a9d-edec-4751-9633-96e97bebb031 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:06.603963 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d8215a9d-edec-4751-9633-96e97bebb031 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:06.610082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8215a9d-edec-4751-9633-96e97bebb031 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:06.610554 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8215a9d-edec-4751-9633-96e97bebb031 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:06.611332 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8215a9d-edec-4751-9633-96e97bebb031 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:06.611776 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8215a9d-edec-4751-9633-96e97bebb031 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:06.776380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d8215a9d-edec-4751-9633-96e97bebb031 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:06.783873 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d8215a9d-edec-4751-9633-96e97bebb031 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1674 microversion: 2.1 time: 0.184301 May 26 19:46:06.784444 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 420/848] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:06 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:07.351506 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0c71d029-9726-4099-b7c9-b3c7a7ea1b53 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:07.352208 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0c71d029-9726-4099-b7c9-b3c7a7ea1b53 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:07.358874 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c71d029-9726-4099-b7c9-b3c7a7ea1b53 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:07.359360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c71d029-9726-4099-b7c9-b3c7a7ea1b53 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:07.360131 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c71d029-9726-4099-b7c9-b3c7a7ea1b53 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:07.360569 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0c71d029-9726-4099-b7c9-b3c7a7ea1b53 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:07.503131 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0c71d029-9726-4099-b7c9-b3c7a7ea1b53 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:07.511543 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0c71d029-9726-4099-b7c9-b3c7a7ea1b53 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1514 microversion: 2.1 time: 0.164805 May 26 19:46:07.512142 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 429/849] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:07 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:07.801161 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5495a02e-8202-44bb-a583-ac38f6a7846d tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:07.801796 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5495a02e-8202-44bb-a583-ac38f6a7846d tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:07.808226 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5495a02e-8202-44bb-a583-ac38f6a7846d tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:07.808672 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5495a02e-8202-44bb-a583-ac38f6a7846d tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:07.809428 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5495a02e-8202-44bb-a583-ac38f6a7846d tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:07.809860 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5495a02e-8202-44bb-a583-ac38f6a7846d tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:07.941471 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5495a02e-8202-44bb-a583-ac38f6a7846d tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:07.949680 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5495a02e-8202-44bb-a583-ac38f6a7846d tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1674 microversion: 2.1 time: 0.152439 May 26 19:46:07.950240 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 421/850] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:07 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:08.529377 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-841ee9b1-c563-497e-acf8-d2dac007ea7f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:08.529996 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-841ee9b1-c563-497e-acf8-d2dac007ea7f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:08.536499 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-841ee9b1-c563-497e-acf8-d2dac007ea7f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:08.536947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-841ee9b1-c563-497e-acf8-d2dac007ea7f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:08.537705 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-841ee9b1-c563-497e-acf8-d2dac007ea7f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:08.538772 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-841ee9b1-c563-497e-acf8-d2dac007ea7f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:08.668150 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-841ee9b1-c563-497e-acf8-d2dac007ea7f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:08.675548 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-841ee9b1-c563-497e-acf8-d2dac007ea7f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1514 microversion: 2.1 time: 0.150088 May 26 19:46:08.676112 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 430/851] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:08 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:08.967156 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a9489302-86bc-4e2e-a1db-c5bb4cc40356 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:08.967719 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a9489302-86bc-4e2e-a1db-c5bb4cc40356 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:08.974201 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a9489302-86bc-4e2e-a1db-c5bb4cc40356 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:08.974650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a9489302-86bc-4e2e-a1db-c5bb4cc40356 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:08.975585 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a9489302-86bc-4e2e-a1db-c5bb4cc40356 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:08.976266 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a9489302-86bc-4e2e-a1db-c5bb4cc40356 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:09.101333 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a9489302-86bc-4e2e-a1db-c5bb4cc40356 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:09.108692 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a9489302-86bc-4e2e-a1db-c5bb4cc40356 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1674 microversion: 2.1 time: 0.145548 May 26 19:46:09.109248 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 422/852] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:08 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:09.692499 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-091caede-cf4f-4a72-9ec7-f23d9e56118f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:09.693090 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-091caede-cf4f-4a72-9ec7-f23d9e56118f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:09.699541 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-091caede-cf4f-4a72-9ec7-f23d9e56118f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:09.699995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-091caede-cf4f-4a72-9ec7-f23d9e56118f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:09.700751 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-091caede-cf4f-4a72-9ec7-f23d9e56118f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:09.701188 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-091caede-cf4f-4a72-9ec7-f23d9e56118f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:09.826808 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-091caede-cf4f-4a72-9ec7-f23d9e56118f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:09.834293 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-091caede-cf4f-4a72-9ec7-f23d9e56118f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1514 microversion: 2.1 time: 0.145698 May 26 19:46:09.835373 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 431/853] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:09 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:10.126279 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-23c32fdd-6516-4119-b303-1ded67d609af tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:10.126883 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-23c32fdd-6516-4119-b303-1ded67d609af tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:10.134039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23c32fdd-6516-4119-b303-1ded67d609af tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:10.134481 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23c32fdd-6516-4119-b303-1ded67d609af tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:10.135253 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23c32fdd-6516-4119-b303-1ded67d609af tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:10.135683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-23c32fdd-6516-4119-b303-1ded67d609af tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:10.336820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-23c32fdd-6516-4119-b303-1ded67d609af tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:10.358753 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-23c32fdd-6516-4119-b303-1ded67d609af tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1674 microversion: 2.1 time: 0.236201 May 26 19:46:10.359367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 423/854] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:10 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:10.825426 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-6016cb17-dd32-4d6b-a087-cefb2778546b req-57cda269-232f-4b2b-83ab-669b938be99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f078ae03-f894-4a29-b0a5-6b1d00cc424d", "name": "network-vif-deleted", "tag": "6fe129fb-f583-4c5e-a15c-855a8b053449"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:10.834234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-6016cb17-dd32-4d6b-a087-cefb2778546b req-57cda269-232f-4b2b-83ab-669b938be99e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:10.834766 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-6016cb17-dd32-4d6b-a087-cefb2778546b req-57cda269-232f-4b2b-83ab-669b938be99e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:10.847176 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-6016cb17-dd32-4d6b-a087-cefb2778546b req-57cda269-232f-4b2b-83ab-669b938be99e service nova] Creating event network-vif-deleted:6fe129fb-f583-4c5e-a15c-855a8b053449 for instance f078ae03-f894-4a29-b0a5-6b1d00cc424d on hv-cinder-82549 May 26 19:46:10.853059 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-6016cb17-dd32-4d6b-a087-cefb2778546b req-57cda269-232f-4b2b-83ab-669b938be99e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031353 May 26 19:46:10.853939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 432/855] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:10.854284 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4fd25ae8-82d7-4f73-8d00-b005837a67d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:10.854931 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4fd25ae8-82d7-4f73-8d00-b005837a67d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:10.862458 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fd25ae8-82d7-4f73-8d00-b005837a67d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:10.862935 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fd25ae8-82d7-4f73-8d00-b005837a67d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:10.863913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fd25ae8-82d7-4f73-8d00-b005837a67d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:10.864356 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fd25ae8-82d7-4f73-8d00-b005837a67d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:10.948870 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4fd25ae8-82d7-4f73-8d00-b005837a67d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:10.956657 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4fd25ae8-82d7-4f73-8d00-b005837a67d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1472 microversion: 2.1 time: 0.108615 May 26 19:46:10.959661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 424/856] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:10 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1472 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:11.377347 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-fb74c9e3-9bad-4c8f-985f-26de8a359e25 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:11.378303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-fb74c9e3-9bad-4c8f-985f-26de8a359e25 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:11.387289 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fb74c9e3-9bad-4c8f-985f-26de8a359e25 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:11.387723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fb74c9e3-9bad-4c8f-985f-26de8a359e25 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:11.388496 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fb74c9e3-9bad-4c8f-985f-26de8a359e25 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:11.388953 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fb74c9e3-9bad-4c8f-985f-26de8a359e25 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:11.451762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-fb74c9e3-9bad-4c8f-985f-26de8a359e25 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:11.459402 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-fb74c9e3-9bad-4c8f-985f-26de8a359e25 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1606 microversion: 2.1 time: 0.086292 May 26 19:46:11.460062 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 433/857] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:11 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1606 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:11.974520 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:11.976230 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:11.982763 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:11.983256 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:11.984742 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:11.985355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:12.019458 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:12.019903 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:12.020381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lazy-loading 'fault' on Instance uuid f078ae03-f894-4a29-b0a5-6b1d00cc424d {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:46:12.071227 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:12.078112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-37212d22-58e6-4289-9fef-9a18567dbb42 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 200 len: 1309 microversion: 2.1 time: 0.108218 May 26 19:46:12.078690 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 425/858] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:11 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:12.476728 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:12.477326 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:12.483878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:12.487137 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:12.487137 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:12.487137 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:12.516652 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:12.517099 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:12.517544 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lazy-loading 'fault' on Instance uuid 2ae90233-1398-44cd-9ac0-9d660d9b6e64 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:46:12.564486 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:12.572869 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6d41aeb7-2815-4f83-96bf-fb275d04f639 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 200 len: 1327 microversion: 2.1 time: 0.100052 May 26 19:46:12.573540 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 434/859] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:12 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:12.868685 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-a6a12280-6115-4b5f-9adc-57897d4ddc86 req-656cdede-d22e-41b3-bac5-1b73a5eac12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae90233-1398-44cd-9ac0-9d660d9b6e64", "name": "network-vif-deleted", "tag": "dd065cbe-f746-42d0-9f46-d21f31e26426"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:12.876988 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-a6a12280-6115-4b5f-9adc-57897d4ddc86 req-656cdede-d22e-41b3-bac5-1b73a5eac12b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:12.877433 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-a6a12280-6115-4b5f-9adc-57897d4ddc86 req-656cdede-d22e-41b3-bac5-1b73a5eac12b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:12.888706 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-a6a12280-6115-4b5f-9adc-57897d4ddc86 req-656cdede-d22e-41b3-bac5-1b73a5eac12b service nova] Creating event network-vif-deleted:dd065cbe-f746-42d0-9f46-d21f31e26426 for instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 on hv-cinder-82549 May 26 19:46:12.893491 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-a6a12280-6115-4b5f-9adc-57897d4ddc86 req-656cdede-d22e-41b3-bac5-1b73a5eac12b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029059 May 26 19:46:12.894055 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 426/860] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:13.095902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:13.096516 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: f078ae03-f894-4a29-b0a5-6b1d00cc424d] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:13.102641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:13.103134 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:13.103891 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:13.104326 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:13.117903 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] HTTP exception thrown: Instance f078ae03-f894-4a29-b0a5-6b1d00cc424d could not be found. May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Request method failure captured: May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d HTTP/1.1 May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9i8njo_n2fB8fRF1Myh1miL5jkE7WZ4DnWHO7bGTxwdjY8fU-0Z9iN1R8cKYnuHTXE-5zIFURwQk3dJHOqxQqGYeEAEBj0fw7OHJpUha-imSeP-biAz0VAW5meJ1YG7foYWJxXommK2M2DjXe3OJVfAlkXT6NICQ6G0wLEniZT2p-w May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: e99682e050fe48ca82cbecebe920a6f9 May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1990387188 May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:46:13.119504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e99682e050fe48ca82cbecebe920a6f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e99682e050fe48ca82cbecebe920a6f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e99682e050fe48ca82cbecebe920a6f9", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e99682e050fe48ca82cbecebe920a6f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-VolumesSnapshotTestJSON-1990387188 May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: e99682e050fe48ca82cbecebe920a6f9 May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1990387188 May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-VolumesSnapshotTestJSON-1990387188-project May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: d38941f7008944e38832411e85316a98 May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-VolumesSnapshotTestJSON-1990387188-project May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance f078ae03-f894-4a29-b0a5-6b1d00cc424d could not be found. May 26 19:46:13.121432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': 'f078ae03-f894-4a29-b0a5-6b1d00cc424d'} May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f078ae03-f894-4a29-b0a5-6b1d00cc424d could not be found. May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:46:13.122391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f078ae03-f894-4a29-b0a5-6b1d00cc424d could not be found. May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f078ae03-f894-4a29-b0a5-6b1d00cc424d could not be found. May 26 19:46:13.123954 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:46:13.125253 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Returning 404 to user: Instance f078ae03-f894-4a29-b0a5-6b1d00cc424d could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:46:13.125253 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7f038ece-b2ef-4231-8bd1-6b118eb87214 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d" status: 404 len: 111 microversion: 2.1 time: 0.029232 May 26 19:46:13.125253 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 435/861] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:13 2022] GET /compute/v2.1/servers/f078ae03-f894-4a29-b0a5-6b1d00cc424d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:46:13.592353 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:13.593052 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:13.599363 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:13.599835 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:13.601355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:13.601790 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:13.614951 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] HTTP exception thrown: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Request method failure captured: May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 HTTP/1.1 May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9giH8Y-2dVzXRrkdTSx7ZT72Z6SyYCDY9UggNpa290gYQ4VSm-hNUq6qbx6FoGoRXdpXHB4m_4VQ5xcA20WxOYTbPZdwUGUy5B22u7GqgpjKHXmoSyg8RphuFQU5u8h_Fjxmr9n0YzZ1lgmLPRGyV8C7wl92CD21Be7-buJx1_YBGI May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:46:13.617117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f6d58e80c3594ae2abb49ade4482dfd3", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeTestJSON-28422270 May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeTestJSON-28422270-project May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 72991fbdeb3d41e6929ad2d6f3c1aaf6 May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeTestJSON-28422270-project May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:46:13.621618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '2ae90233-1398-44cd-9ac0-9d660d9b6e64'} May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:46:13.622567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:46:13.624054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:46:13.625355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Returning 404 to user: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:46:13.625355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e41787b8-269e-42d9-b8d5-c0a2c54b8d5f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 404 len: 111 microversion: 2.1 time: 0.030950 May 26 19:46:13.625355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 427/862] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:13 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:46:13.627939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-511f21b6-0604-46bb-9fd4-aaa21f7fa5a5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '.version_select at 0x7fa7884533a0>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:13.631469 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR oslo.messaging._drivers.impl_rabbit [None req-511f21b6-0604-46bb-9fd4-aaa21f7fa5a5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [cd2cc256-e613-4151-b483-28be5363b678] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 19:46:14.638816 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO oslo.messaging._drivers.impl_rabbit [None req-511f21b6-0604-46bb-9fd4-aaa21f7fa5a5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [cd2cc256-e613-4151-b483-28be5363b678] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 55124. May 26 19:46:14.772745 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-511f21b6-0604-46bb-9fd4-aaa21f7fa5a5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480506312" status: 202 len: 0 microversion: 2.1 time: 1.148686 May 26 19:46:14.773345 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 436/863] 10.222.0.72 () {58 vars in 1220 bytes} [Thu May 26 19:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480506312 => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:46:15.508792 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c382168a-0b57-40de-a36a-7d6463523f40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'create', calling method: .version_select at 0x7fa78818c040>, body: {"keypair": {"name": "tempest-keypair-940810939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdZ5qle896oxHe65L5yXrc+wlBUaJj5+kxkQ8+7hOGQfQ3j/ysCJiq3vUbrPeD03JRl5AFxbWYK8plpAx9eXFwSW93cwJm+gQAt9oMZF1Vvb+lTM7ObRQox3jf2z2ol3A=="}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:15.523783 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-c382168a-0b57-40de-a36a-7d6463523f40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Getting quotas for project f6d58e80c3594ae2abb49ade4482dfd3. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:46:15.527597 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-c382168a-0b57-40de-a36a-7d6463523f40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Getting quotas for user 72991fbdeb3d41e6929ad2d6f3c1aaf6 and project f6d58e80c3594ae2abb49ade4482dfd3. Resources: {'key_pairs'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:46:15.606807 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c382168a-0b57-40de-a36a-7d6463523f40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102610 May 26 19:46:15.607451 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 428/864] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:46:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:18.221567 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1952297945", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d90aacf-7ed7-4464-b873-af570bc85444"}], "security_groups": [{"name": "tempest-securitygroup--1361637317"}], "key_name": "tempest-keypair-940810939", "user_data": "}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:18.321054 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] validate_networks() for [('3d90aacf-7ed7-4464-b873-af570bc85444', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:46:18.672564 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:46:18.672988 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:46:18.673464 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:46:18.673904 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:46:18.674447 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:46:18.684371 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:18.684762 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:18.685588 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:18.686025 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:18.703041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Getting quotas for project f6d58e80c3594ae2abb49ade4482dfd3. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:46:18.707057 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Getting quotas for user 72991fbdeb3d41e6929ad2d6f3c1aaf6 and project f6d58e80c3594ae2abb49ade4482dfd3. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:46:18.718232 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:46:18.720504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:46:18.830264 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-18398d9d-ecf8-4754-9e19-7888b9e02d67 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613543 May 26 19:46:18.830908 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 437/865] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:46:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:46:18.843395 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b97e6669-5f73-406d-b5e7-b42c97b6f86e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:18.844108 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b97e6669-5f73-406d-b5e7-b42c97b6f86e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:18.900896 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b97e6669-5f73-406d-b5e7-b42c97b6f86e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:18.907697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b97e6669-5f73-406d-b5e7-b42c97b6f86e tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1237 microversion: 2.1 time: 0.070126 May 26 19:46:18.908286 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 429/866] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:18 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:19.925572 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0f489d38-1645-47ad-8a05-96092e11fe36 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:19.926179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0f489d38-1645-47ad-8a05-96092e11fe36 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:19.933014 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0f489d38-1645-47ad-8a05-96092e11fe36 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:19.933461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0f489d38-1645-47ad-8a05-96092e11fe36 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:19.934218 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0f489d38-1645-47ad-8a05-96092e11fe36 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:19.934651 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0f489d38-1645-47ad-8a05-96092e11fe36 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:19.998732 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0f489d38-1645-47ad-8a05-96092e11fe36 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:20.006201 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0f489d38-1645-47ad-8a05-96092e11fe36 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1241 microversion: 2.1 time: 0.085091 May 26 19:46:20.006761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 438/867] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:19 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:21.022718 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f4841623-717b-4a11-bfc0-add98ead0b88 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:21.023358 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f4841623-717b-4a11-bfc0-add98ead0b88 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:21.031119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f4841623-717b-4a11-bfc0-add98ead0b88 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:21.031564 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f4841623-717b-4a11-bfc0-add98ead0b88 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:21.032325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f4841623-717b-4a11-bfc0-add98ead0b88 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:21.032755 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f4841623-717b-4a11-bfc0-add98ead0b88 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:21.098123 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f4841623-717b-4a11-bfc0-add98ead0b88 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:21.107404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f4841623-717b-4a11-bfc0-add98ead0b88 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1233 microversion: 2.1 time: 0.088471 May 26 19:46:21.107970 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 430/868] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:21 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:22.125295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-75c98e4b-cb89-4815-84ed-1e0570cd1716 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:22.125895 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-75c98e4b-cb89-4815-84ed-1e0570cd1716 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:22.132352 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75c98e4b-cb89-4815-84ed-1e0570cd1716 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:22.132792 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75c98e4b-cb89-4815-84ed-1e0570cd1716 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:22.133548 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75c98e4b-cb89-4815-84ed-1e0570cd1716 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:22.133976 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75c98e4b-cb89-4815-84ed-1e0570cd1716 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:22.192419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-75c98e4b-cb89-4815-84ed-1e0570cd1716 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:22.199682 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-75c98e4b-cb89-4815-84ed-1e0570cd1716 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1233 microversion: 2.1 time: 0.078760 May 26 19:46:22.200237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 439/869] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:22 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1233 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:23.216497 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1b97ff2a-4f84-402f-abfe-11ac0ba25e47 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:23.217091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1b97ff2a-4f84-402f-abfe-11ac0ba25e47 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:23.223707 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1b97ff2a-4f84-402f-abfe-11ac0ba25e47 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:23.224199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1b97ff2a-4f84-402f-abfe-11ac0ba25e47 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:23.224966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1b97ff2a-4f84-402f-abfe-11ac0ba25e47 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:23.225409 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1b97ff2a-4f84-402f-abfe-11ac0ba25e47 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:23.289010 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1b97ff2a-4f84-402f-abfe-11ac0ba25e47 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:23.296398 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1b97ff2a-4f84-402f-abfe-11ac0ba25e47 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1289 microversion: 2.1 time: 0.083984 May 26 19:46:23.296953 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 431/870] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:23 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:23.856654 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-448499832", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "networks": [{"uuid": "34f3a739-7e78-433b-8a6a-0d4643be2b0c"}]}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:23.908081 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] validate_networks() for [('34f3a739-7e78-433b-8a6a-0d4643be2b0c', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:46:24.314238 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-042ba740-e0be-4d7d-8ab9-804cfbf36d07 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:24.315492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-042ba740-e0be-4d7d-8ab9-804cfbf36d07 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:24.325745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-042ba740-e0be-4d7d-8ab9-804cfbf36d07 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:24.326620 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-042ba740-e0be-4d7d-8ab9-804cfbf36d07 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:24.328297 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-042ba740-e0be-4d7d-8ab9-804cfbf36d07 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:24.328967 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-042ba740-e0be-4d7d-8ab9-804cfbf36d07 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:24.507168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:46:24.507593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:46:24.508067 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:46:24.508505 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:46:24.508919 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:46:24.518964 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:24.519802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:24.520214 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:24.520651 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:24.538776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Getting quotas for project e99682e050fe48ca82cbecebe920a6f9. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:46:24.545860 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Getting quotas for user d38941f7008944e38832411e85316a98 and project e99682e050fe48ca82cbecebe920a6f9. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:46:24.546005 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-042ba740-e0be-4d7d-8ab9-804cfbf36d07 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:24.555376 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-042ba740-e0be-4d7d-8ab9-804cfbf36d07 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1363 microversion: 2.1 time: 0.246484 May 26 19:46:24.555775 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:46:24.556612 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 432/871] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:24 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:24.558161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:46:24.673079 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ab5c186f-45b3-4991-a5f7-1c9467d825c9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820123 May 26 19:46:24.678768 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 440/872] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:46:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:46:24.685238 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bbf860b5-15e3-4adc-be9b-7d15ed15e603 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:24.686566 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bbf860b5-15e3-4adc-be9b-7d15ed15e603 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:24.764617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-bbf860b5-15e3-4adc-be9b-7d15ed15e603 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:24.788064 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bbf860b5-15e3-4adc-be9b-7d15ed15e603 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1218 microversion: 2.1 time: 0.107435 May 26 19:46:24.791202 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 433/873] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:24 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:25.356142 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-508c0692-a1b1-4705-ad9d-5fa73f038376 req-86475c65-b4ec-4982-865c-aef512e294e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e438f4b-10f6-4fee-8c25-59798fde83de", "tag": "28b54a18-eac4-47ed-9cdf-47ca938b6d20"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:25.364668 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-508c0692-a1b1-4705-ad9d-5fa73f038376 req-86475c65-b4ec-4982-865c-aef512e294e4 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:25.365341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-508c0692-a1b1-4705-ad9d-5fa73f038376 req-86475c65-b4ec-4982-865c-aef512e294e4 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:25.379621 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-508c0692-a1b1-4705-ad9d-5fa73f038376 req-86475c65-b4ec-4982-865c-aef512e294e4 service nova] Creating event network-changed:28b54a18-eac4-47ed-9cdf-47ca938b6d20 for instance 3e438f4b-10f6-4fee-8c25-59798fde83de on hv-cinder-82549 May 26 19:46:25.385593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-508c0692-a1b1-4705-ad9d-5fa73f038376 req-86475c65-b4ec-4982-865c-aef512e294e4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033897 May 26 19:46:25.386463 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 441/874] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:25.573114 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-84f8a9c2-b0b6-46e6-a054-f244424fa23c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:25.574361 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-84f8a9c2-b0b6-46e6-a054-f244424fa23c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:25.581922 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-84f8a9c2-b0b6-46e6-a054-f244424fa23c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:25.582616 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-84f8a9c2-b0b6-46e6-a054-f244424fa23c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:25.583590 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-84f8a9c2-b0b6-46e6-a054-f244424fa23c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:25.584020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-84f8a9c2-b0b6-46e6-a054-f244424fa23c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:25.763681 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-84f8a9c2-b0b6-46e6-a054-f244424fa23c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:25.771642 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-84f8a9c2-b0b6-46e6-a054-f244424fa23c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1363 microversion: 2.1 time: 0.202470 May 26 19:46:25.772212 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 434/875] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:25 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:25.805942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-31ed8139-69ee-4cf9-bead-3c76f04b9470 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:25.806645 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-31ed8139-69ee-4cf9-bead-3c76f04b9470 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:25.813474 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-31ed8139-69ee-4cf9-bead-3c76f04b9470 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:25.813924 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-31ed8139-69ee-4cf9-bead-3c76f04b9470 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:25.814699 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-31ed8139-69ee-4cf9-bead-3c76f04b9470 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:25.815160 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-31ed8139-69ee-4cf9-bead-3c76f04b9470 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:25.883203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-31ed8139-69ee-4cf9-bead-3c76f04b9470 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:25.892142 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-31ed8139-69ee-4cf9-bead-3c76f04b9470 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1222 microversion: 2.1 time: 0.090305 May 26 19:46:25.892726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 442/876] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:25 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:26.792479 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7fd6617b-6065-4b16-b852-3cb4cdafbacb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:26.793086 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7fd6617b-6065-4b16-b852-3cb4cdafbacb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:26.799494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7fd6617b-6065-4b16-b852-3cb4cdafbacb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:26.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7fd6617b-6065-4b16-b852-3cb4cdafbacb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:26.800694 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7fd6617b-6065-4b16-b852-3cb4cdafbacb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:26.801124 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7fd6617b-6065-4b16-b852-3cb4cdafbacb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:26.909319 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-eb2643f8-d9f0-4884-b02c-2c7b0299a44f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:26.909916 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-eb2643f8-d9f0-4884-b02c-2c7b0299a44f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:26.916300 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eb2643f8-d9f0-4884-b02c-2c7b0299a44f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:26.916743 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eb2643f8-d9f0-4884-b02c-2c7b0299a44f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:26.917489 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eb2643f8-d9f0-4884-b02c-2c7b0299a44f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:26.918019 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-eb2643f8-d9f0-4884-b02c-2c7b0299a44f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:26.933537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7fd6617b-6065-4b16-b852-3cb4cdafbacb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:26.941365 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7fd6617b-6065-4b16-b852-3cb4cdafbacb tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1363 microversion: 2.1 time: 0.152771 May 26 19:46:26.941928 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 435/877] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:26 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:26.978097 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-eb2643f8-d9f0-4884-b02c-2c7b0299a44f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:26.985571 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-eb2643f8-d9f0-4884-b02c-2c7b0299a44f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1278 microversion: 2.1 time: 0.080088 May 26 19:46:26.986129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 443/878] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:26 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1278 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:27.958490 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-dbceee11-7f01-4876-b9c6-57c97b97ff81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:27.959130 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-dbceee11-7f01-4876-b9c6-57c97b97ff81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:27.965589 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dbceee11-7f01-4876-b9c6-57c97b97ff81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:27.966040 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dbceee11-7f01-4876-b9c6-57c97b97ff81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:27.966795 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dbceee11-7f01-4876-b9c6-57c97b97ff81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:27.967255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dbceee11-7f01-4876-b9c6-57c97b97ff81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:28.003532 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-40fb0ab5-3d41-4a7f-8bfe-beefbff7d8ad tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:28.004141 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-40fb0ab5-3d41-4a7f-8bfe-beefbff7d8ad tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:28.010489 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-40fb0ab5-3d41-4a7f-8bfe-beefbff7d8ad tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:28.010963 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-40fb0ab5-3d41-4a7f-8bfe-beefbff7d8ad tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:28.011721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-40fb0ab5-3d41-4a7f-8bfe-beefbff7d8ad tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:28.012149 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-40fb0ab5-3d41-4a7f-8bfe-beefbff7d8ad tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:28.016147 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:28.141106 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-40fb0ab5-3d41-4a7f-8bfe-beefbff7d8ad tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:28.148622 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-40fb0ab5-3d41-4a7f-8bfe-beefbff7d8ad tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1318 microversion: 2.1 time: 0.148933 May 26 19:46:28.149194 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 444/879] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:27 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:28.190521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-dbceee11-7f01-4876-b9c6-57c97b97ff81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:28.194094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:28.198339 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-dbceee11-7f01-4876-b9c6-57c97b97ff81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1363 microversion: 2.1 time: 0.243895 May 26 19:46:28.198890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 436/880] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:27 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:29.166011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e5297301-1e47-491a-afc8-3b359bdf10c3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:29.166525 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e5297301-1e47-491a-afc8-3b359bdf10c3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:29.173382 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e5297301-1e47-491a-afc8-3b359bdf10c3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:29.173827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e5297301-1e47-491a-afc8-3b359bdf10c3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:29.174589 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e5297301-1e47-491a-afc8-3b359bdf10c3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:29.175054 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e5297301-1e47-491a-afc8-3b359bdf10c3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:29.216089 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0d1d77e1-a69f-43fc-b325-435a1a7ce2a9 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:29.218089 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0d1d77e1-a69f-43fc-b325-435a1a7ce2a9 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:29.227687 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0d1d77e1-a69f-43fc-b325-435a1a7ce2a9 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:29.227687 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0d1d77e1-a69f-43fc-b325-435a1a7ce2a9 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:29.227912 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0d1d77e1-a69f-43fc-b325-435a1a7ce2a9 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:29.228404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0d1d77e1-a69f-43fc-b325-435a1a7ce2a9 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:29.321713 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e5297301-1e47-491a-afc8-3b359bdf10c3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:29.329812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e5297301-1e47-491a-afc8-3b359bdf10c3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1318 microversion: 2.1 time: 0.167734 May 26 19:46:29.330388 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 445/881] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:29 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:29.342215 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-e6c01c98-3cdd-4e84-871d-a0ec36b08ba7 req-f24e48a4-c013-4803-8ff5-bf4db8cacd73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ce9526-7917-479d-aefc-ffa68226c8c1", "tag": "74f87602-52d0-4adf-a55e-d380907c4661"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:29.350482 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-e6c01c98-3cdd-4e84-871d-a0ec36b08ba7 req-f24e48a4-c013-4803-8ff5-bf4db8cacd73 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:29.351199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-e6c01c98-3cdd-4e84-871d-a0ec36b08ba7 req-f24e48a4-c013-4803-8ff5-bf4db8cacd73 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:29.362126 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-e6c01c98-3cdd-4e84-871d-a0ec36b08ba7 req-f24e48a4-c013-4803-8ff5-bf4db8cacd73 service nova] Creating event network-changed:74f87602-52d0-4adf-a55e-d380907c4661 for instance 13ce9526-7917-479d-aefc-ffa68226c8c1 on hv-cinder-82549 May 26 19:46:29.367373 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-e6c01c98-3cdd-4e84-871d-a0ec36b08ba7 req-f24e48a4-c013-4803-8ff5-bf4db8cacd73 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031085 May 26 19:46:29.368162 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 446/882] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:29.395015 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0d1d77e1-a69f-43fc-b325-435a1a7ce2a9 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:29.402412 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0d1d77e1-a69f-43fc-b325-435a1a7ce2a9 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1363 microversion: 2.1 time: 0.191031 May 26 19:46:29.403347 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 437/883] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:29 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:30.347541 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9013d54b-c414-4a1f-a468-75b94376903c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:30.348235 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9013d54b-c414-4a1f-a468-75b94376903c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:30.355967 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9013d54b-c414-4a1f-a468-75b94376903c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:30.356421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9013d54b-c414-4a1f-a468-75b94376903c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:30.357323 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9013d54b-c414-4a1f-a468-75b94376903c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:30.357831 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9013d54b-c414-4a1f-a468-75b94376903c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:30.419277 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-121e0813-bcc5-4868-b3b1-35fde9d1ab72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:30.419894 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-121e0813-bcc5-4868-b3b1-35fde9d1ab72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:30.426888 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-121e0813-bcc5-4868-b3b1-35fde9d1ab72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:30.427404 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-121e0813-bcc5-4868-b3b1-35fde9d1ab72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:30.428175 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-121e0813-bcc5-4868-b3b1-35fde9d1ab72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:30.428622 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-121e0813-bcc5-4868-b3b1-35fde9d1ab72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:30.488820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9013d54b-c414-4a1f-a468-75b94376903c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:30.496521 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9013d54b-c414-4a1f-a468-75b94376903c tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1318 microversion: 2.1 time: 0.153244 May 26 19:46:30.497084 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 447/884] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:30 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:30.561621 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-121e0813-bcc5-4868-b3b1-35fde9d1ab72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:30.569020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-121e0813-bcc5-4868-b3b1-35fde9d1ab72 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1363 microversion: 2.1 time: 0.153626 May 26 19:46:30.569588 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 438/885] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:30 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:31.513468 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8678e513-6696-4e6b-a93b-ddc7df281c45 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:31.514094 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8678e513-6696-4e6b-a93b-ddc7df281c45 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:31.520719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8678e513-6696-4e6b-a93b-ddc7df281c45 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:31.521166 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8678e513-6696-4e6b-a93b-ddc7df281c45 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:31.521935 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8678e513-6696-4e6b-a93b-ddc7df281c45 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:31.522372 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8678e513-6696-4e6b-a93b-ddc7df281c45 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:31.586970 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-13fa5d5c-a8da-4639-816a-87d300b0a06c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:31.587687 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-13fa5d5c-a8da-4639-816a-87d300b0a06c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:31.594909 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-13fa5d5c-a8da-4639-816a-87d300b0a06c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:31.595464 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-13fa5d5c-a8da-4639-816a-87d300b0a06c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:31.596458 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-13fa5d5c-a8da-4639-816a-87d300b0a06c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:31.596979 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-13fa5d5c-a8da-4639-816a-87d300b0a06c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:31.662264 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8678e513-6696-4e6b-a93b-ddc7df281c45 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:31.671203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8678e513-6696-4e6b-a93b-ddc7df281c45 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1318 microversion: 2.1 time: 0.160915 May 26 19:46:31.672042 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 448/886] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:31 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:31.688926 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-76fdc023-2a69-4457-be45-1861fb1b7330 req-0dae3a88-52cc-4d8c-941f-a20983180cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e438f4b-10f6-4fee-8c25-59798fde83de", "name": "network-vif-plugged", "status": "completed", "tag": "28b54a18-eac4-47ed-9cdf-47ca938b6d20"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:31.698028 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-76fdc023-2a69-4457-be45-1861fb1b7330 req-0dae3a88-52cc-4d8c-941f-a20983180cae service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:31.698678 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-76fdc023-2a69-4457-be45-1861fb1b7330 req-0dae3a88-52cc-4d8c-941f-a20983180cae service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:31.710303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-76fdc023-2a69-4457-be45-1861fb1b7330 req-0dae3a88-52cc-4d8c-941f-a20983180cae service nova] Creating event network-vif-plugged:28b54a18-eac4-47ed-9cdf-47ca938b6d20 for instance 3e438f4b-10f6-4fee-8c25-59798fde83de on hv-cinder-82549 May 26 19:46:31.715191 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-76fdc023-2a69-4457-be45-1861fb1b7330 req-0dae3a88-52cc-4d8c-941f-a20983180cae service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030084 May 26 19:46:31.715776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 449/887] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:46:31.738669 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-13fa5d5c-a8da-4639-816a-87d300b0a06c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:31.746710 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-13fa5d5c-a8da-4639-816a-87d300b0a06c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1363 microversion: 2.1 time: 0.163776 May 26 19:46:31.747314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 439/888] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:31 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:32.690498 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d9ef58a0-ed2a-495f-a532-25e66fb8e8c1 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:32.691345 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d9ef58a0-ed2a-495f-a532-25e66fb8e8c1 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:32.697850 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d9ef58a0-ed2a-495f-a532-25e66fb8e8c1 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:32.698293 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d9ef58a0-ed2a-495f-a532-25e66fb8e8c1 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:32.699118 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d9ef58a0-ed2a-495f-a532-25e66fb8e8c1 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:32.699548 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d9ef58a0-ed2a-495f-a532-25e66fb8e8c1 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:32.763564 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-817ce216-4f2c-4723-b384-bbc517204626 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:32.764205 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-817ce216-4f2c-4723-b384-bbc517204626 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:32.772889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-817ce216-4f2c-4723-b384-bbc517204626 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:32.773643 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-817ce216-4f2c-4723-b384-bbc517204626 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:32.774428 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-817ce216-4f2c-4723-b384-bbc517204626 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:32.774869 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-817ce216-4f2c-4723-b384-bbc517204626 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:32.835821 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d9ef58a0-ed2a-495f-a532-25e66fb8e8c1 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:32.844017 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d9ef58a0-ed2a-495f-a532-25e66fb8e8c1 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1318 microversion: 2.1 time: 0.158238 May 26 19:46:32.845496 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 450/889] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:32 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:32.924537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-817ce216-4f2c-4723-b384-bbc517204626 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:32.935296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-817ce216-4f2c-4723-b384-bbc517204626 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1363 microversion: 2.1 time: 0.175581 May 26 19:46:32.935881 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 440/890] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:32 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:33.861566 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-904124e8-c31f-4bc6-b505-d8b3e7291d12 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:33.862203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-904124e8-c31f-4bc6-b505-d8b3e7291d12 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:33.864684 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:33.869415 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-904124e8-c31f-4bc6-b505-d8b3e7291d12 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:33.869864 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-904124e8-c31f-4bc6-b505-d8b3e7291d12 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:33.870910 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-904124e8-c31f-4bc6-b505-d8b3e7291d12 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:33.871359 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-904124e8-c31f-4bc6-b505-d8b3e7291d12 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:33.952327 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1620fc5f-8295-41f7-9664-9535ceb75381 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:33.956749 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1620fc5f-8295-41f7-9664-9535ceb75381 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:33.959866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1620fc5f-8295-41f7-9664-9535ceb75381 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:33.960315 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1620fc5f-8295-41f7-9664-9535ceb75381 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:33.961075 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1620fc5f-8295-41f7-9664-9535ceb75381 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:33.961506 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1620fc5f-8295-41f7-9664-9535ceb75381 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:34.007471 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-904124e8-c31f-4bc6-b505-d8b3e7291d12 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:34.016939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-904124e8-c31f-4bc6-b505-d8b3e7291d12 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1318 microversion: 2.1 time: 0.159271 May 26 19:46:34.018180 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 451/891] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:33 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:34.106159 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1620fc5f-8295-41f7-9664-9535ceb75381 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:34.114487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1620fc5f-8295-41f7-9664-9535ceb75381 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1363 microversion: 2.1 time: 0.166185 May 26 19:46:34.115087 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 441/892] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:33 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:35.035117 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-05d54599-3d0c-431f-aeba-f3111560dd36 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:35.035763 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-05d54599-3d0c-431f-aeba-f3111560dd36 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:35.037530 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=4 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:35.038179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=12 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:35.043743 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-05d54599-3d0c-431f-aeba-f3111560dd36 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:35.044186 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-05d54599-3d0c-431f-aeba-f3111560dd36 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:35.044938 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-05d54599-3d0c-431f-aeba-f3111560dd36 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:35.045415 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-05d54599-3d0c-431f-aeba-f3111560dd36 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:35.131707 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8388fd32-d162-4401-aa30-36ce70226b40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:35.132311 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8388fd32-d162-4401-aa30-36ce70226b40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:35.134172 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=8 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:35.139472 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8388fd32-d162-4401-aa30-36ce70226b40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:35.139920 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8388fd32-d162-4401-aa30-36ce70226b40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:35.140673 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8388fd32-d162-4401-aa30-36ce70226b40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:35.141102 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8388fd32-d162-4401-aa30-36ce70226b40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:35.180346 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-05d54599-3d0c-431f-aeba-f3111560dd36 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:35.188429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-05d54599-3d0c-431f-aeba-f3111560dd36 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1318 microversion: 2.1 time: 0.158018 May 26 19:46:35.189021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 452/893] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:35 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:35.273138 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8388fd32-d162-4401-aa30-36ce70226b40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:35.280585 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8388fd32-d162-4401-aa30-36ce70226b40 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1548 microversion: 2.1 time: 0.152827 May 26 19:46:35.281429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 442/894] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:35 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:46:35.306423 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-39e3d649-a736-469b-ae66-ab7cadc31231 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:35.306848 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-39e3d649-a736-469b-ae66-ab7cadc31231 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:35.313531 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-39e3d649-a736-469b-ae66-ab7cadc31231 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:35.313978 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-39e3d649-a736-469b-ae66-ab7cadc31231 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:35.314736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-39e3d649-a736-469b-ae66-ab7cadc31231 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:35.315206 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-39e3d649-a736-469b-ae66-ab7cadc31231 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:35.392163 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-39e3d649-a736-469b-ae66-ab7cadc31231 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089168 May 26 19:46:35.402911 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 453/895] 10.222.0.72 () {58 vars in 1274 bytes} [Thu May 26 19:46:35 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:35.756086 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-6c3dccaf-3424-4fdb-9e17-d25c9885d79d req-7d9adaf0-b404-4c82-b0c4-dcf60d3e04c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ce9526-7917-479d-aefc-ffa68226c8c1", "name": "network-vif-plugged", "status": "completed", "tag": "74f87602-52d0-4adf-a55e-d380907c4661"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:35.764209 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-6c3dccaf-3424-4fdb-9e17-d25c9885d79d req-7d9adaf0-b404-4c82-b0c4-dcf60d3e04c7 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:35.764647 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-6c3dccaf-3424-4fdb-9e17-d25c9885d79d req-7d9adaf0-b404-4c82-b0c4-dcf60d3e04c7 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:35.776532 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-6c3dccaf-3424-4fdb-9e17-d25c9885d79d req-7d9adaf0-b404-4c82-b0c4-dcf60d3e04c7 service nova] Creating event network-vif-plugged:74f87602-52d0-4adf-a55e-d380907c4661 for instance 13ce9526-7917-479d-aefc-ffa68226c8c1 on hv-cinder-82549 May 26 19:46:35.781924 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-6c3dccaf-3424-4fdb-9e17-d25c9885d79d req-7d9adaf0-b404-4c82-b0c4-dcf60d3e04c7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029901 May 26 19:46:35.787085 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 443/896] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:36.207549 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-50f2f914-57b5-4810-8919-6d83a884a41f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:36.208168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-50f2f914-57b5-4810-8919-6d83a884a41f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:36.220129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50f2f914-57b5-4810-8919-6d83a884a41f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:36.220629 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50f2f914-57b5-4810-8919-6d83a884a41f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:36.221411 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50f2f914-57b5-4810-8919-6d83a884a41f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:36.221875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-50f2f914-57b5-4810-8919-6d83a884a41f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:36.403442 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-50f2f914-57b5-4810-8919-6d83a884a41f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:36.410750 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-50f2f914-57b5-4810-8919-6d83a884a41f tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1318 microversion: 2.1 time: 0.209335 May 26 19:46:36.414156 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 454/897] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:36 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:36.501788 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-78940884-ce9e-4f35-b33c-7d9e0c98a03b req-87a1184c-7896-40d8-b849-fb193f0716cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e438f4b-10f6-4fee-8c25-59798fde83de", "tag": "28b54a18-eac4-47ed-9cdf-47ca938b6d20"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:36.505840 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:36.511510 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-78940884-ce9e-4f35-b33c-7d9e0c98a03b req-87a1184c-7896-40d8-b849-fb193f0716cd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:36.512045 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-78940884-ce9e-4f35-b33c-7d9e0c98a03b req-87a1184c-7896-40d8-b849-fb193f0716cd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:36.524318 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-78940884-ce9e-4f35-b33c-7d9e0c98a03b req-87a1184c-7896-40d8-b849-fb193f0716cd service nova] Creating event network-changed:28b54a18-eac4-47ed-9cdf-47ca938b6d20 for instance 3e438f4b-10f6-4fee-8c25-59798fde83de on hv-cinder-82549 May 26 19:46:36.529719 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-78940884-ce9e-4f35-b33c-7d9e0c98a03b req-87a1184c-7896-40d8-b849-fb193f0716cd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032451 May 26 19:46:36.530564 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 444/898] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:37.427714 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6c8ecbb3-f76e-4e0e-abdb-b943aa99bbfc tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:37.428310 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6c8ecbb3-f76e-4e0e-abdb-b943aa99bbfc tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:37.435118 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6c8ecbb3-f76e-4e0e-abdb-b943aa99bbfc tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:37.435570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6c8ecbb3-f76e-4e0e-abdb-b943aa99bbfc tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:37.436353 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6c8ecbb3-f76e-4e0e-abdb-b943aa99bbfc tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:37.437063 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6c8ecbb3-f76e-4e0e-abdb-b943aa99bbfc tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:37.631333 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6c8ecbb3-f76e-4e0e-abdb-b943aa99bbfc tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:37.638212 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6c8ecbb3-f76e-4e0e-abdb-b943aa99bbfc tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1318 microversion: 2.1 time: 0.214385 May 26 19:46:37.638778 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 455/899] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:37 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:38.656016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-eee6be01-2a94-4650-b2cc-755aeffea552 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:38.656626 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-eee6be01-2a94-4650-b2cc-755aeffea552 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:38.665291 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eee6be01-2a94-4650-b2cc-755aeffea552 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:38.665876 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eee6be01-2a94-4650-b2cc-755aeffea552 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:38.666633 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eee6be01-2a94-4650-b2cc-755aeffea552 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:38.667099 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eee6be01-2a94-4650-b2cc-755aeffea552 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:38.800601 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-eee6be01-2a94-4650-b2cc-755aeffea552 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:38.808496 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-eee6be01-2a94-4650-b2cc-755aeffea552 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1507 microversion: 2.1 time: 0.156787 May 26 19:46:38.810619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 445/900] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:38 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:38.825236 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1a04eb7e-d912-440f-805f-20adab6c04d9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97fbab42-80e6-4cfb-9190-09c11cdba08d", "device": "/dev/sdb"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:38.826846 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1a04eb7e-d912-440f-805f-20adab6c04d9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:38.833855 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1a04eb7e-d912-440f-805f-20adab6c04d9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:38.834304 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1a04eb7e-d912-440f-805f-20adab6c04d9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:38.835169 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1a04eb7e-d912-440f-805f-20adab6c04d9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:38.835609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1a04eb7e-d912-440f-805f-20adab6c04d9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:39.615945 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1a04eb7e-d912-440f-805f-20adab6c04d9 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "POST /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794495 May 26 19:46:39.616864 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 456/901] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:46:38 2022] POST /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:56.982206 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7a2212d5-e016-44da-a809-ccbfe56c2277 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:56.983376 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7a2212d5-e016-44da-a809-ccbfe56c2277 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:56.985872 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-f18db1ea-e29b-46ba-8bb2-49fe51c1a56f req-ab82c905-ea75-4b54-b40d-4e7e065bf78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b866a8-96fd-4c60-ac2c-9fbaf249c843", "tag": "5ecc06c8-c98f-447b-9a1b-988dbfb4aa53"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:56.986598 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:56.987768 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=46 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:56.991011 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=11 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:56.991997 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:56.995568 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7a2212d5-e016-44da-a809-ccbfe56c2277 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:56.996011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7a2212d5-e016-44da-a809-ccbfe56c2277 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:56.997156 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7a2212d5-e016-44da-a809-ccbfe56c2277 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:56.997262 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7a2212d5-e016-44da-a809-ccbfe56c2277 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:57.003483 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-f18db1ea-e29b-46ba-8bb2-49fe51c1a56f req-ab82c905-ea75-4b54-b40d-4e7e065bf78b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:57.004018 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-f18db1ea-e29b-46ba-8bb2-49fe51c1a56f req-ab82c905-ea75-4b54-b40d-4e7e065bf78b service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:57.016032 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-f18db1ea-e29b-46ba-8bb2-49fe51c1a56f req-ab82c905-ea75-4b54-b40d-4e7e065bf78b service nova] Creating event network-changed:5ecc06c8-c98f-447b-9a1b-988dbfb4aa53 for instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 on hv-cinder-82549 May 26 19:46:57.027031 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-f18db1ea-e29b-46ba-8bb2-49fe51c1a56f req-ab82c905-ea75-4b54-b40d-4e7e065bf78b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046378 May 26 19:46:57.028000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 457/902] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:57.029855 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7a2212d5-e016-44da-a809-ccbfe56c2277 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:46:57.371927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7a2212d5-e016-44da-a809-ccbfe56c2277 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 204 len: 0 microversion: 2.1 time: 0.393977 May 26 19:46:57.378602 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 446/903] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:46:56 2022] DELETE /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:46:57.385133 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-35213819-ea09-437f-9496-4510c7411319 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:57.385860 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-35213819-ea09-437f-9496-4510c7411319 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:57.392721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-35213819-ea09-437f-9496-4510c7411319 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:57.393169 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-35213819-ea09-437f-9496-4510c7411319 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:57.393926 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-35213819-ea09-437f-9496-4510c7411319 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:57.394386 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-35213819-ea09-437f-9496-4510c7411319 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:57.700537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-35213819-ea09-437f-9496-4510c7411319 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:57.708467 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-35213819-ea09-437f-9496-4510c7411319 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1580 microversion: 2.1 time: 0.328057 May 26 19:46:57.709149 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 458/904] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:57 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1580 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:58.726149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-33ba1887-aea2-4b9a-a606-fae2631a5d9a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:58.726844 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-33ba1887-aea2-4b9a-a606-fae2631a5d9a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:58.733596 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-33ba1887-aea2-4b9a-a606-fae2631a5d9a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:58.734218 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-33ba1887-aea2-4b9a-a606-fae2631a5d9a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:58.735208 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-33ba1887-aea2-4b9a-a606-fae2631a5d9a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:58.735650 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-33ba1887-aea2-4b9a-a606-fae2631a5d9a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:58.947413 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-33ba1887-aea2-4b9a-a606-fae2631a5d9a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:46:58.955716 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-33ba1887-aea2-4b9a-a606-fae2631a5d9a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1580 microversion: 2.1 time: 0.233838 May 26 19:46:58.956364 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 447/905] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:58 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1580 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:46:59.659601 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-be8a2b18-8516-4183-b197-80e235c34dd4 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:59.660397 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-be8a2b18-8516-4183-b197-80e235c34dd4 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:59.666934 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-be8a2b18-8516-4183-b197-80e235c34dd4 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:59.667404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-be8a2b18-8516-4183-b197-80e235c34dd4 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:59.668219 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-be8a2b18-8516-4183-b197-80e235c34dd4 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:59.668753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-be8a2b18-8516-4183-b197-80e235c34dd4 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:59.765109 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-be8a2b18-8516-4183-b197-80e235c34dd4 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lazy-loading 'services' on Instance uuid 13ce9526-7917-479d-aefc-ffa68226c8c1 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:46:59.792025 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-081df76b-37c9-463b-a0f8-f58fd5510a77 req-b4801ca9-5a70-475a-be71-0fa3944a0d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b866a8-96fd-4c60-ac2c-9fbaf249c843", "name": "network-vif-deleted", "tag": "5ecc06c8-c98f-447b-9a1b-988dbfb4aa53"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:46:59.801639 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-081df76b-37c9-463b-a0f8-f58fd5510a77 req-b4801ca9-5a70-475a-be71-0fa3944a0d83 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:59.802086 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-081df76b-37c9-463b-a0f8-f58fd5510a77 req-b4801ca9-5a70-475a-be71-0fa3944a0d83 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:59.813297 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-081df76b-37c9-463b-a0f8-f58fd5510a77 req-b4801ca9-5a70-475a-be71-0fa3944a0d83 service nova] Creating event network-vif-deleted:5ecc06c8-c98f-447b-9a1b-988dbfb4aa53 for instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 on hv-cinder-82549 May 26 19:46:59.818342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-081df76b-37c9-463b-a0f8-f58fd5510a77 req-b4801ca9-5a70-475a-be71-0fa3944a0d83 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030643 May 26 19:46:59.819151 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 448/906] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:46:59.974370 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-63cf2a11-74c7-4044-9c31-0afc47d5b70f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:46:59.975260 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-63cf2a11-74c7-4044-9c31-0afc47d5b70f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:46:59.981979 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63cf2a11-74c7-4044-9c31-0afc47d5b70f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:59.982426 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63cf2a11-74c7-4044-9c31-0afc47d5b70f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:46:59.983212 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63cf2a11-74c7-4044-9c31-0afc47d5b70f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:46:59.983640 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63cf2a11-74c7-4044-9c31-0afc47d5b70f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:00.033900 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-be8a2b18-8516-4183-b197-80e235c34dd4 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "DELETE /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1/os-volume_attachments/97fbab42-80e6-4cfb-9190-09c11cdba08d" status: 202 len: 0 microversion: 2.1 time: 0.378326 May 26 19:47:00.034862 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 459/907] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:46:59 2022] DELETE /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1/os-volume_attachments/97fbab42-80e6-4cfb-9190-09c11cdba08d => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:47:00.055270 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-63cf2a11-74c7-4044-9c31-0afc47d5b70f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:00.067625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-63cf2a11-74c7-4044-9c31-0afc47d5b70f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1226 microversion: 2.1 time: 0.093434 May 26 19:47:00.067625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 449/908] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:46:59 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:47:01.086812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:01.087571 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:01.097666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:01.098038 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:01.098822 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:01.099283 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:01.137318 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:01.143018 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:01.143018 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lazy-loading 'fault' on Instance uuid a1b866a8-96fd-4c60-ac2c-9fbaf249c843 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:47:01.154834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5d6d306c-23e0-475d-b3d4-cb4e2e0cacfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:01.155420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5d6d306c-23e0-475d-b3d4-cb4e2e0cacfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:01.162094 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5d6d306c-23e0-475d-b3d4-cb4e2e0cacfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:01.162553 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5d6d306c-23e0-475d-b3d4-cb4e2e0cacfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:01.163366 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5d6d306c-23e0-475d-b3d4-cb4e2e0cacfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:01.163813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5d6d306c-23e0-475d-b3d4-cb4e2e0cacfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:01.183588 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:01.189716 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5d6d306c-23e0-475d-b3d4-cb4e2e0cacfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:47:01.191234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a70a6517-5689-434b-b67d-e7e1e0ffb447 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 200 len: 1231 microversion: 2.1 time: 0.113144 May 26 19:47:01.191804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 460/909] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:01 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 1231 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:01.525313 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5d6d306c-23e0-475d-b3d4-cb4e2e0cacfa tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "DELETE /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 204 len: 0 microversion: 2.1 time: 0.376161 May 26 19:47:01.527025 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 450/910] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:47:01 2022] DELETE /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 19:47:01.535652 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-03af0330-5ba9-4218-bbb0-0249945aea43 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:01.536269 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-03af0330-5ba9-4218-bbb0-0249945aea43 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:01.542265 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-03af0330-5ba9-4218-bbb0-0249945aea43 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:01.542718 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-03af0330-5ba9-4218-bbb0-0249945aea43 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:01.543515 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-03af0330-5ba9-4218-bbb0-0249945aea43 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:01.544005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-03af0330-5ba9-4218-bbb0-0249945aea43 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:01.669191 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-03af0330-5ba9-4218-bbb0-0249945aea43 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:01.676666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-03af0330-5ba9-4218-bbb0-0249945aea43 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1513 microversion: 2.1 time: 0.144873 May 26 19:47:01.677293 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 461/911] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:01 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:02.208986 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:02.209694 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: a1b866a8-96fd-4c60-ac2c-9fbaf249c843] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:02.216139 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:02.216589 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:02.217351 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:02.217788 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:02.230977 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] HTTP exception thrown: Instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 could not be found. May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Request method failure captured: May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 HTTP/1.1 May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9dODe5177Owy3dpm-4gbvmIKgYtSpVzffHNxVZXJ-h64nADjxTGo92T5LEKufth1ZKSjB--VZugjOSvzN6X7t_ghsD9lzjjp8X9KlWmg_jE4tL1voONS0j2SXg0ZIODQzxRbDh6J8ZcC1BNj2GcPLfDY4TxW6XXy5TlSRX-rIgsJBY May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:47:02.233060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_dabc38fc95184250b1d9e7090ab73b2c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-TestVolumeBootPattern-128423126 May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-TestVolumeBootPattern-128423126-project May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: fe347ddb98df4018b1b9d65db314d8d8 May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-TestVolumeBootPattern-128423126-project May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 could not be found. May 26 19:47:02.234751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'a1b866a8-96fd-4c60-ac2c-9fbaf249c843'} May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 could not be found. May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:02.235709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 could not be found. May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 could not be found. May 26 19:47:02.237237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:02.238567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Returning 404 to user: Instance a1b866a8-96fd-4c60-ac2c-9fbaf249c843 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:02.238567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0e187b42-2b8f-4dd1-aeb5-6e79dc44482a tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843" status: 404 len: 111 microversion: 2.1 time: 0.029674 May 26 19:47:02.238567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 451/912] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:02 2022] GET /compute/v2.1/servers/a1b866a8-96fd-4c60-ac2c-9fbaf249c843 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:47:02.693752 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a6b75380-15ba-461b-aa6f-94b7ea206c11 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:02.694360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a6b75380-15ba-461b-aa6f-94b7ea206c11 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:02.700884 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a6b75380-15ba-461b-aa6f-94b7ea206c11 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:02.701320 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a6b75380-15ba-461b-aa6f-94b7ea206c11 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:02.702107 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a6b75380-15ba-461b-aa6f-94b7ea206c11 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:02.702543 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a6b75380-15ba-461b-aa6f-94b7ea206c11 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:02.832906 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a6b75380-15ba-461b-aa6f-94b7ea206c11 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:02.841414 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a6b75380-15ba-461b-aa6f-94b7ea206c11 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1513 microversion: 2.1 time: 0.151068 May 26 19:47:02.841970 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 462/913] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:02 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:03.859529 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-9a61a6ad-dce8-42c2-809d-4626da0353d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:03.860228 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-9a61a6ad-dce8-42c2-809d-4626da0353d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:03.867025 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9a61a6ad-dce8-42c2-809d-4626da0353d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:03.867474 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9a61a6ad-dce8-42c2-809d-4626da0353d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:03.868233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9a61a6ad-dce8-42c2-809d-4626da0353d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:03.868664 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-9a61a6ad-dce8-42c2-809d-4626da0353d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:04.074334 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-9a61a6ad-dce8-42c2-809d-4626da0353d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:04.081994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-9a61a6ad-dce8-42c2-809d-4626da0353d3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1513 microversion: 2.1 time: 0.226861 May 26 19:47:04.082567 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 452/914] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:03 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:04.313251 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-8dd6fc1b-330b-4477-ba83-4652ad0939ba req-4c8b7513-2c8a-4258-89a8-1e47bc0e2427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ce9526-7917-479d-aefc-ffa68226c8c1", "name": "network-vif-deleted", "tag": "74f87602-52d0-4adf-a55e-d380907c4661"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:47:04.321805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-8dd6fc1b-330b-4477-ba83-4652ad0939ba req-4c8b7513-2c8a-4258-89a8-1e47bc0e2427 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:04.322234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-8dd6fc1b-330b-4477-ba83-4652ad0939ba req-4c8b7513-2c8a-4258-89a8-1e47bc0e2427 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:04.334234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-8dd6fc1b-330b-4477-ba83-4652ad0939ba req-4c8b7513-2c8a-4258-89a8-1e47bc0e2427 service nova] Creating event network-vif-deleted:74f87602-52d0-4adf-a55e-d380907c4661 for instance 13ce9526-7917-479d-aefc-ffa68226c8c1 on hv-cinder-82549 May 26 19:47:04.339092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-8dd6fc1b-330b-4477-ba83-4652ad0939ba req-4c8b7513-2c8a-4258-89a8-1e47bc0e2427 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030063 May 26 19:47:04.339626 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 463/915] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:05.099921 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:05.100550 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:05.108033 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:05.108487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:05.109265 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:05.109702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:05.142818 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:05.143304 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:05.143747 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lazy-loading 'fault' on Instance uuid 13ce9526-7917-479d-aefc-ffa68226c8c1 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:47:05.187108 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38941f7008944e38832411e85316a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99682e050fe48ca82cbecebe920a6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:05.194822 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2ab93093-6804-47f2-8ed2-86e48044812a tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 200 len: 1308 microversion: 2.1 time: 0.098749 May 26 19:47:05.204915 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 453/916] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:05 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:05.809334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2e711b28-2747-410d-9076-63e5ae8886fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:05.812712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2e711b28-2747-410d-9076-63e5ae8886fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:05.812849 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-63ab394d-e440-42b6-997d-33941f32f8c8 req-74f32a42-f428-42a5-9a96-2a430803296e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3557b49-893e-4c9b-bc84-324e8db5117e", "tag": "65821ee3-a623-4001-a22a-7ee3a346e6ea"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:47:05.817445 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2e711b28-2747-410d-9076-63e5ae8886fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:05.817970 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2e711b28-2747-410d-9076-63e5ae8886fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:05.818806 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2e711b28-2747-410d-9076-63e5ae8886fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:05.819323 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2e711b28-2747-410d-9076-63e5ae8886fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:05.820463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-63ab394d-e440-42b6-997d-33941f32f8c8 req-74f32a42-f428-42a5-9a96-2a430803296e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:05.820984 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-63ab394d-e440-42b6-997d-33941f32f8c8 req-74f32a42-f428-42a5-9a96-2a430803296e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:05.833012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-63ab394d-e440-42b6-997d-33941f32f8c8 req-74f32a42-f428-42a5-9a96-2a430803296e service nova] Creating event network-changed:65821ee3-a623-4001-a22a-7ee3a346e6ea for instance d3557b49-893e-4c9b-bc84-324e8db5117e on hv-cinder-82549 May 26 19:47:05.838315 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-63ab394d-e440-42b6-997d-33941f32f8c8 req-74f32a42-f428-42a5-9a96-2a430803296e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030810 May 26 19:47:05.839471 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 454/917] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:05.849137 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2e711b28-2747-410d-9076-63e5ae8886fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:47:06.124258 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2e711b28-2747-410d-9076-63e5ae8886fd tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 204 len: 0 microversion: 2.1 time: 0.319639 May 26 19:47:06.124988 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 464/918] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:47:05 2022] DELETE /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:47:06.135744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-61ce7cfe-6644-49f1-9784-1d30e74a8125 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:06.143281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-61ce7cfe-6644-49f1-9784-1d30e74a8125 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:06.143281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-61ce7cfe-6644-49f1-9784-1d30e74a8125 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:06.144014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-61ce7cfe-6644-49f1-9784-1d30e74a8125 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:06.144938 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-61ce7cfe-6644-49f1-9784-1d30e74a8125 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:06.145510 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-61ce7cfe-6644-49f1-9784-1d30e74a8125 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:06.214044 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:06.214768 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] [instance: 13ce9526-7917-479d-aefc-ffa68226c8c1] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:06.220845 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:06.221298 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:06.222097 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:06.222540 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:06.237283 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] HTTP exception thrown: Instance 13ce9526-7917-479d-aefc-ffa68226c8c1 could not be found. May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Request method failure captured: May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 HTTP/1.1 May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9i8njo_n2fB8fRF1Myh1miL5jkE7WZ4DnWHO7bGTxwdjY8fU-0Z9iN1R8cKYnuHTXE-5zIFURwQk3dJHOqxQqGYeEAEBj0fw7OHJpUha-imSeP-biAz0VAW5meJ1YG7foYWJxXommK2M2DjXe3OJVfAlkXT6NICQ6G0wLEniZT2p-w May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: e99682e050fe48ca82cbecebe920a6f9 May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1990387188 May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:47:06.238966 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e99682e050fe48ca82cbecebe920a6f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e99682e050fe48ca82cbecebe920a6f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e99682e050fe48ca82cbecebe920a6f9", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e99682e050fe48ca82cbecebe920a6f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-VolumesSnapshotTestJSON-1990387188 May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: e99682e050fe48ca82cbecebe920a6f9 May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1990387188 May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-VolumesSnapshotTestJSON-1990387188-project May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: d38941f7008944e38832411e85316a98 May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-VolumesSnapshotTestJSON-1990387188-project May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 13ce9526-7917-479d-aefc-ffa68226c8c1 could not be found. May 26 19:47:06.240391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '13ce9526-7917-479d-aefc-ffa68226c8c1'} May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ce9526-7917-479d-aefc-ffa68226c8c1 could not be found. May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:06.241185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ce9526-7917-479d-aefc-ffa68226c8c1 could not be found. May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ce9526-7917-479d-aefc-ffa68226c8c1 could not be found. May 26 19:47:06.242491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:06.243691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] Returning 404 to user: Instance 13ce9526-7917-479d-aefc-ffa68226c8c1 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:06.243691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-004bb1b8-724d-464c-b087-78b62d387bd3 tempest-VolumesSnapshotTestJSON-1990387188 tempest-VolumesSnapshotTestJSON-1990387188-project] 10.222.0.72 "GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1" status: 404 len: 111 microversion: 2.1 time: 0.031419 May 26 19:47:06.246256 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 465/919] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:06 2022] GET /compute/v2.1/servers/13ce9526-7917-479d-aefc-ffa68226c8c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:47:06.287099 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-61ce7cfe-6644-49f1-9784-1d30e74a8125 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:06.295607 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-61ce7cfe-6644-49f1-9784-1d30e74a8125 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1580 microversion: 2.1 time: 0.165798 May 26 19:47:06.296428 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 455/920] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:06 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1580 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:07.312804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5a7d53b6-58d9-4280-82a6-111412a4970f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:07.313411 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5a7d53b6-58d9-4280-82a6-111412a4970f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:07.320049 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5a7d53b6-58d9-4280-82a6-111412a4970f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:07.320495 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5a7d53b6-58d9-4280-82a6-111412a4970f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:07.321252 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5a7d53b6-58d9-4280-82a6-111412a4970f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:07.321683 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5a7d53b6-58d9-4280-82a6-111412a4970f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:07.464541 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5a7d53b6-58d9-4280-82a6-111412a4970f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:07.472016 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5a7d53b6-58d9-4280-82a6-111412a4970f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1580 microversion: 2.1 time: 0.163629 May 26 19:47:07.472588 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 466/921] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:07 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1580 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:08.459357 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-54b2629d-2755-4813-abab-768d16e886c6 req-5fa9a53d-fd07-46a0-8ccb-1788de44e16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3557b49-893e-4c9b-bc84-324e8db5117e", "name": "network-vif-deleted", "tag": "65821ee3-a623-4001-a22a-7ee3a346e6ea"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:47:08.468083 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-54b2629d-2755-4813-abab-768d16e886c6 req-5fa9a53d-fd07-46a0-8ccb-1788de44e16a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:08.468527 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-54b2629d-2755-4813-abab-768d16e886c6 req-5fa9a53d-fd07-46a0-8ccb-1788de44e16a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:08.479560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-54b2629d-2755-4813-abab-768d16e886c6 req-5fa9a53d-fd07-46a0-8ccb-1788de44e16a service nova] Creating event network-vif-deleted:65821ee3-a623-4001-a22a-7ee3a346e6ea for instance d3557b49-893e-4c9b-bc84-324e8db5117e on hv-cinder-82549 May 26 19:47:08.484920 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-54b2629d-2755-4813-abab-768d16e886c6 req-5fa9a53d-fd07-46a0-8ccb-1788de44e16a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029329 May 26 19:47:08.485499 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 456/922] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:08.489727 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-05c6e1cd-6802-4a83-861d-347fe927e953 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:08.490335 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-05c6e1cd-6802-4a83-861d-347fe927e953 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:08.497756 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-05c6e1cd-6802-4a83-861d-347fe927e953 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:08.498223 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-05c6e1cd-6802-4a83-861d-347fe927e953 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:08.499046 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-05c6e1cd-6802-4a83-861d-347fe927e953 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:08.499488 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-05c6e1cd-6802-4a83-861d-347fe927e953 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:08.562846 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-05c6e1cd-6802-4a83-861d-347fe927e953 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:08.570611 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-05c6e1cd-6802-4a83-861d-347fe927e953 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1393 microversion: 2.1 time: 0.084821 May 26 19:47:08.571217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 467/923] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:08 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1393 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:47:09.588737 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a26778fd-7a24-47b5-ada3-4ce861bfd9b2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:09.589349 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a26778fd-7a24-47b5-ada3-4ce861bfd9b2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:09.595543 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a26778fd-7a24-47b5-ada3-4ce861bfd9b2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:09.595990 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a26778fd-7a24-47b5-ada3-4ce861bfd9b2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:09.596744 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a26778fd-7a24-47b5-ada3-4ce861bfd9b2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:09.597176 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a26778fd-7a24-47b5-ada3-4ce861bfd9b2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:09.659918 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-a26778fd-7a24-47b5-ada3-4ce861bfd9b2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:09.667328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a26778fd-7a24-47b5-ada3-4ce861bfd9b2 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1226 microversion: 2.1 time: 0.083251 May 26 19:47:09.667890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 457/924] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:09 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:10.685383 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5c6269eb-657b-4ac3-9d41-593c3182621e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:10.685940 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5c6269eb-657b-4ac3-9d41-593c3182621e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:10.692597 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c6269eb-657b-4ac3-9d41-593c3182621e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:10.693076 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c6269eb-657b-4ac3-9d41-593c3182621e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:10.693839 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c6269eb-657b-4ac3-9d41-593c3182621e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:10.694274 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5c6269eb-657b-4ac3-9d41-593c3182621e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:10.754307 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5c6269eb-657b-4ac3-9d41-593c3182621e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:10.761911 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5c6269eb-657b-4ac3-9d41-593c3182621e tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1226 microversion: 2.1 time: 0.080596 May 26 19:47:10.762473 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 468/925] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:10 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:11.780119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:11.780719 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:11.786670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:11.789609 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:11.789609 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:11.789609 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:11.819358 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:11.819854 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:11.820290 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lazy-loading 'fault' on Instance uuid d3557b49-893e-4c9b-bc84-324e8db5117e {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:47:11.862065 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe347ddb98df4018b1b9d65db314d8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc38fc95184250b1d9e7090ab73b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:11.874632 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6bf82980-6441-4f8d-a3dc-f1d03e6e4720 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 200 len: 1231 microversion: 2.1 time: 0.099070 May 26 19:47:11.875250 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 458/926] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:11 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:12.892717 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:12.893284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: d3557b49-893e-4c9b-bc84-324e8db5117e] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:12.900341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:12.900789 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:12.901567 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:12.902006 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:12.917048 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] HTTP exception thrown: Instance d3557b49-893e-4c9b-bc84-324e8db5117e could not be found. May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Request method failure captured: May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e HTTP/1.1 May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9dODe5177Owy3dpm-4gbvmIKgYtSpVzffHNxVZXJ-h64nADjxTGo92T5LEKufth1ZKSjB--VZugjOSvzN6X7t_ghsD9lzjjp8X9KlWmg_jE4tL1voONS0j2SXg0ZIODQzxRbDh6J8ZcC1BNj2GcPLfDY4TxW6XXy5TlSRX-rIgsJBY May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:47:12.918641 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_dabc38fc95184250b1d9e7090ab73b2c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-TestVolumeBootPattern-128423126 May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-TestVolumeBootPattern-128423126-project May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: fe347ddb98df4018b1b9d65db314d8d8 May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-TestVolumeBootPattern-128423126-project May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance d3557b49-893e-4c9b-bc84-324e8db5117e could not be found. May 26 19:47:12.920404 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': 'd3557b49-893e-4c9b-bc84-324e8db5117e'} May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3557b49-893e-4c9b-bc84-324e8db5117e could not be found. May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:12.921357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3557b49-893e-4c9b-bc84-324e8db5117e could not be found. May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3557b49-893e-4c9b-bc84-324e8db5117e could not be found. May 26 19:47:12.922892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:12.924540 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Returning 404 to user: Instance d3557b49-893e-4c9b-bc84-324e8db5117e could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:12.924540 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a61b3234-dc30-40f1-9538-5fb75d21407f tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e" status: 404 len: 111 microversion: 2.1 time: 0.031632 May 26 19:47:12.924540 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 469/927] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:12 2022] GET /compute/v2.1/servers/d3557b49-893e-4c9b-bc84-324e8db5117e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:47:13.432492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:13.432983 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:13.440380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:13.441008 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:13.441799 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:13.442239 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:13.457110 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] HTTP exception thrown: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Request method failure captured: May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: DELETE /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f HTTP/1.1 May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9dODe5177Owy3dpm-4gbvmIKgYtSpVzffHNxVZXJ-h64nADjxTGo92T5LEKufth1ZKSjB--VZugjOSvzN6X7t_ghsD9lzjjp8X9KlWmg_jE4tL1voONS0j2SXg0ZIODQzxRbDh6J8ZcC1BNj2GcPLfDY4TxW6XXy5TlSRX-rIgsJBY May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:47:13.458914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_dabc38fc95184250b1d9e7090ab73b2c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-TestVolumeBootPattern-128423126 May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-TestVolumeBootPattern-128423126-project May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: fe347ddb98df4018b1b9d65db314d8d8 May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-TestVolumeBootPattern-128423126-project May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.460492 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '41d24bae-e684-487b-88b1-c134195fe54f'} May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:13.461380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.462808 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:13.466480 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Returning 404 to user: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:13.466480 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7877ce4f-f661-421e-994e-34cef7b414c6 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "DELETE /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 404 len: 111 microversion: 2.1 time: 0.031831 May 26 19:47:13.466480 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 459/928] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:47:13 2022] DELETE /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:47:13.469686 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:13.470291 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] [instance: 41d24bae-e684-487b-88b1-c134195fe54f] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:13.476243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:13.476690 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:13.477441 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:13.477879 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:13.491277 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] HTTP exception thrown: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Request method failure captured: May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f HTTP/1.1 May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9dODe5177Owy3dpm-4gbvmIKgYtSpVzffHNxVZXJ-h64nADjxTGo92T5LEKufth1ZKSjB--VZugjOSvzN6X7t_ghsD9lzjjp8X9KlWmg_jE4tL1voONS0j2SXg0ZIODQzxRbDh6J8ZcC1BNj2GcPLfDY4TxW6XXy5TlSRX-rIgsJBY May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:47:13.493285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_dabc38fc95184250b1d9e7090ab73b2c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/dabc38fc95184250b1d9e7090ab73b2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-TestVolumeBootPattern-128423126 May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: dabc38fc95184250b1d9e7090ab73b2c May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-TestVolumeBootPattern-128423126 May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-TestVolumeBootPattern-128423126-project May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: fe347ddb98df4018b1b9d65db314d8d8 May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-TestVolumeBootPattern-128423126-project May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.494883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '41d24bae-e684-487b-88b1-c134195fe54f'} May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:13.496064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. May 26 19:47:13.497458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:13.498727 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Returning 404 to user: Instance 41d24bae-e684-487b-88b1-c134195fe54f could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:13.498727 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0cd3e9d7-0e1a-4c44-9543-24d39fcfd672 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f" status: 404 len: 111 microversion: 2.1 time: 0.028888 May 26 19:47:13.498727 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 470/929] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:13 2022] GET /compute/v2.1/servers/41d24bae-e684-487b-88b1-c134195fe54f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:47:15.033079 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-640de086-0214-43c8-95a6-c6231a185317 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] Calling method '.version_select at 0x7fa7881a48b0>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:15.135527 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-640de086-0214-43c8-95a6-c6231a185317 tempest-TestVolumeBootPattern-128423126 tempest-TestVolumeBootPattern-128423126-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1830455866" status: 202 len: 0 microversion: 2.1 time: 0.106960 May 26 19:47:15.136114 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 460/930] 10.222.0.72 () {58 vars in 1262 bytes} [Thu May 26 19:47:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1830455866 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:47:20.168924 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5ed3e328-ee91-4ca3-9acb-42908603b540 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:20.169494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5ed3e328-ee91-4ca3-9acb-42908603b540 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:20.176457 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5ed3e328-ee91-4ca3-9acb-42908603b540 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:20.176902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5ed3e328-ee91-4ca3-9acb-42908603b540 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:20.177661 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5ed3e328-ee91-4ca3-9acb-42908603b540 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:20.178101 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5ed3e328-ee91-4ca3-9acb-42908603b540 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:20.201497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5ed3e328-ee91-4ca3-9acb-42908603b540 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/ips" status: 200 len: 144 microversion: 2.1 time: 0.036517 May 26 19:47:20.202072 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 471/931] 10.222.0.72 () {58 vars in 1247 bytes} [Thu May 26 19:47:20 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:23.006440 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-68fc246f-1b22-4ad4-aac9-22bebee20fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad89de26-ce66-475a-8fa6-8e7fa245759d"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:47:23.007549 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-68fc246f-1b22-4ad4-aac9-22bebee20fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:23.015549 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-68fc246f-1b22-4ad4-aac9-22bebee20fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:23.015999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-68fc246f-1b22-4ad4-aac9-22bebee20fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:23.016772 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-68fc246f-1b22-4ad4-aac9-22bebee20fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:23.017236 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-68fc246f-1b22-4ad4-aac9-22bebee20fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:24.493341 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:24.918803 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-68fc246f-1b22-4ad4-aac9-22bebee20fbc tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.917088 May 26 19:47:24.919697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 461/932] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:47:23 2022] POST /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments => generated 194 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:32.642855 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3a0e3745-98c9-445e-9a7b-f7dae0df835f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:32.643829 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3a0e3745-98c9-445e-9a7b-f7dae0df835f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:32.646111 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:32.646759 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:32.651507 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3a0e3745-98c9-445e-9a7b-f7dae0df835f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:32.651960 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3a0e3745-98c9-445e-9a7b-f7dae0df835f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:32.652756 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3a0e3745-98c9-445e-9a7b-f7dae0df835f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:32.653182 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3a0e3745-98c9-445e-9a7b-f7dae0df835f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:32.683554 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3a0e3745-98c9-445e-9a7b-f7dae0df835f tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 May 26 19:47:32.684105 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 472/933] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:47:32 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:32.695233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8364d963-d435-45f5-9417-dacd322a1cd7 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:32.695814 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8364d963-d435-45f5-9417-dacd322a1cd7 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:32.698202 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:32.703616 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8364d963-d435-45f5-9417-dacd322a1cd7 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:32.704064 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8364d963-d435-45f5-9417-dacd322a1cd7 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:32.704849 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8364d963-d435-45f5-9417-dacd322a1cd7 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:32.710148 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8364d963-d435-45f5-9417-dacd322a1cd7 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:32.733783 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8364d963-d435-45f5-9417-dacd322a1cd7 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/ad89de26-ce66-475a-8fa6-8e7fa245759d" status: 200 len: 194 microversion: 2.1 time: 0.043573 May 26 19:47:32.734351 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 462/934] 10.222.0.72 () {58 vars in 1412 bytes} [Thu May 26 19:47:32 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/ad89de26-ce66-475a-8fa6-8e7fa245759d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:34.420285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f2237003-5fe3-4fd4-b5ea-6aa493142944 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "879cbd73-280d-4323-9f86-6664c6c97de3"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:47:34.421343 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f2237003-5fe3-4fd4-b5ea-6aa493142944 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:34.428931 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f2237003-5fe3-4fd4-b5ea-6aa493142944 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:34.429712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f2237003-5fe3-4fd4-b5ea-6aa493142944 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:34.430285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f2237003-5fe3-4fd4-b5ea-6aa493142944 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:34.430726 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f2237003-5fe3-4fd4-b5ea-6aa493142944 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:35.369071 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f2237003-5fe3-4fd4-b5ea-6aa493142944 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "POST /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.952978 May 26 19:47:35.373077 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 473/935] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:47:34 2022] POST /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments => generated 194 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:42.933270 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2a878b83-98e3-42c4-8024-83532e801739 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:42.934372 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2a878b83-98e3-42c4-8024-83532e801739 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:42.943328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a878b83-98e3-42c4-8024-83532e801739 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:42.943775 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a878b83-98e3-42c4-8024-83532e801739 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:42.944632 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a878b83-98e3-42c4-8024-83532e801739 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:42.945163 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a878b83-98e3-42c4-8024-83532e801739 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:42.976988 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2a878b83-98e3-42c4-8024-83532e801739 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048561 May 26 19:47:42.977665 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 463/936] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:47:42 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:43.141061 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8dc849b7-5618-411f-8849-1153644ee870 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:43.142234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8dc849b7-5618-411f-8849-1153644ee870 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:43.154116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8dc849b7-5618-411f-8849-1153644ee870 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:43.154761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8dc849b7-5618-411f-8849-1153644ee870 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:43.155933 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8dc849b7-5618-411f-8849-1153644ee870 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:43.156711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8dc849b7-5618-411f-8849-1153644ee870 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:43.209492 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8dc849b7-5618-411f-8849-1153644ee870 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/ad89de26-ce66-475a-8fa6-8e7fa245759d" status: 200 len: 194 microversion: 2.1 time: 0.075760 May 26 19:47:43.219001 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 474/937] 10.222.0.72 () {58 vars in 1412 bytes} [Thu May 26 19:47:43 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/ad89de26-ce66-475a-8fa6-8e7fa245759d => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:43.220376 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bf3423e8-fcf1-47e5-87e0-3fd8374d1fb8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:43.221590 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bf3423e8-fcf1-47e5-87e0-3fd8374d1fb8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:43.229107 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bf3423e8-fcf1-47e5-87e0-3fd8374d1fb8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:43.229565 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bf3423e8-fcf1-47e5-87e0-3fd8374d1fb8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:43.230436 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bf3423e8-fcf1-47e5-87e0-3fd8374d1fb8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:43.231249 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bf3423e8-fcf1-47e5-87e0-3fd8374d1fb8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:43.336912 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-bf3423e8-fcf1-47e5-87e0-3fd8374d1fb8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lazy-loading 'services' on Instance uuid 3e438f4b-10f6-4fee-8c25-59798fde83de {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:47:43.616095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bf3423e8-fcf1-47e5-87e0-3fd8374d1fb8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/ad89de26-ce66-475a-8fa6-8e7fa245759d" status: 202 len: 0 microversion: 2.1 time: 0.399465 May 26 19:47:43.619853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 464/938] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:47:43 2022] DELETE /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/ad89de26-ce66-475a-8fa6-8e7fa245759d => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:47:45.805537 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-614ce6f8-4320-4073-b20f-7bed01c7e2c5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:45.806290 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-614ce6f8-4320-4073-b20f-7bed01c7e2c5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:45.813782 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-614ce6f8-4320-4073-b20f-7bed01c7e2c5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:45.814228 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-614ce6f8-4320-4073-b20f-7bed01c7e2c5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:45.816135 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-614ce6f8-4320-4073-b20f-7bed01c7e2c5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:45.816570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-614ce6f8-4320-4073-b20f-7bed01c7e2c5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:45.856591 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-614ce6f8-4320-4073-b20f-7bed01c7e2c5 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/879cbd73-280d-4323-9f86-6664c6c97de3" status: 200 len: 194 microversion: 2.1 time: 0.055240 May 26 19:47:45.857894 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 475/939] 10.222.0.72 () {58 vars in 1412 bytes} [Thu May 26 19:47:45 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/879cbd73-280d-4323-9f86-6664c6c97de3 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:45.869220 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-00af8a35-17bf-4b38-b81c-21bc6d3d9646 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:45.869800 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-00af8a35-17bf-4b38-b81c-21bc6d3d9646 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:45.877349 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00af8a35-17bf-4b38-b81c-21bc6d3d9646 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:45.877798 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00af8a35-17bf-4b38-b81c-21bc6d3d9646 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:45.881119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00af8a35-17bf-4b38-b81c-21bc6d3d9646 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:45.881119 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-00af8a35-17bf-4b38-b81c-21bc6d3d9646 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:45.994609 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-00af8a35-17bf-4b38-b81c-21bc6d3d9646 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lazy-loading 'services' on Instance uuid 3e438f4b-10f6-4fee-8c25-59798fde83de {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:47:46.273245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-00af8a35-17bf-4b38-b81c-21bc6d3d9646 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/879cbd73-280d-4323-9f86-6664c6c97de3" status: 202 len: 0 microversion: 2.1 time: 0.408632 May 26 19:47:46.274025 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 465/940] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:47:45 2022] DELETE /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments/879cbd73-280d-4323-9f86-6664c6c97de3 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:47:47.505624 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-20973a37-5881-49bb-96c5-503bf7df4255 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:47.506716 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-20973a37-5881-49bb-96c5-503bf7df4255 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:47.515866 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-20973a37-5881-49bb-96c5-503bf7df4255 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:47.516508 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-20973a37-5881-49bb-96c5-503bf7df4255 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:47.517529 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-20973a37-5881-49bb-96c5-503bf7df4255 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:47.518208 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-20973a37-5881-49bb-96c5-503bf7df4255 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:47.561999 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-20973a37-5881-49bb-96c5-503bf7df4255 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060702 May 26 19:47:47.563075 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 476/941] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:47:47 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 19:47:47.686029 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b221431d-7d17-4050-a7ff-82b439faac5c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:47.687694 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b221431d-7d17-4050-a7ff-82b439faac5c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:47.695206 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b221431d-7d17-4050-a7ff-82b439faac5c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:47.695662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b221431d-7d17-4050-a7ff-82b439faac5c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:47.696436 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b221431d-7d17-4050-a7ff-82b439faac5c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:47.696863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b221431d-7d17-4050-a7ff-82b439faac5c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:47.726780 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b221431d-7d17-4050-a7ff-82b439faac5c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045170 May 26 19:47:47.727408 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 466/942] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:47:47 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 19:47:47.788978 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-cd7e4ab3-fb87-4423-b477-460a130dc74a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:47.789478 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-cd7e4ab3-fb87-4423-b477-460a130dc74a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:47.795924 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cd7e4ab3-fb87-4423-b477-460a130dc74a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:47.796361 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cd7e4ab3-fb87-4423-b477-460a130dc74a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:47.797519 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cd7e4ab3-fb87-4423-b477-460a130dc74a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:47.798124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cd7e4ab3-fb87-4423-b477-460a130dc74a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:47.827253 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-cd7e4ab3-fb87-4423-b477-460a130dc74a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:47:48.193270 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-cd7e4ab3-fb87-4423-b477-460a130dc74a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 204 len: 0 microversion: 2.1 time: 0.407836 May 26 19:47:48.194099 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 477/943] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:47:47 2022] DELETE /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 19:47:48.202235 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d35d41d9-211f-4caf-adf7-a1b663128ba1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:48.203020 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d35d41d9-211f-4caf-adf7-a1b663128ba1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:48.210836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d35d41d9-211f-4caf-adf7-a1b663128ba1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:48.211323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d35d41d9-211f-4caf-adf7-a1b663128ba1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:48.212100 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d35d41d9-211f-4caf-adf7-a1b663128ba1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:48.212538 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d35d41d9-211f-4caf-adf7-a1b663128ba1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:48.440527 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d35d41d9-211f-4caf-adf7-a1b663128ba1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:48.448699 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d35d41d9-211f-4caf-adf7-a1b663128ba1 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1672 microversion: 2.1 time: 0.250292 May 26 19:47:48.449278 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 467/944] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:48 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1672 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:49.470213 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1945cdd6-c0cc-4452-943c-ec9d469381b6 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:49.472071 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1945cdd6-c0cc-4452-943c-ec9d469381b6 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:49.482586 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1945cdd6-c0cc-4452-943c-ec9d469381b6 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:49.483068 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1945cdd6-c0cc-4452-943c-ec9d469381b6 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:49.483856 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1945cdd6-c0cc-4452-943c-ec9d469381b6 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:49.496161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1945cdd6-c0cc-4452-943c-ec9d469381b6 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:49.641233 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1945cdd6-c0cc-4452-943c-ec9d469381b6 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:49.649784 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1945cdd6-c0cc-4452-943c-ec9d469381b6 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1672 microversion: 2.1 time: 0.186047 May 26 19:47:49.650936 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 478/945] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:49 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:50.670125 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b01bc53d-7546-445d-9eff-7a302ecd93e8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:50.671519 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b01bc53d-7546-445d-9eff-7a302ecd93e8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:50.679603 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b01bc53d-7546-445d-9eff-7a302ecd93e8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:50.680433 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b01bc53d-7546-445d-9eff-7a302ecd93e8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:50.681516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b01bc53d-7546-445d-9eff-7a302ecd93e8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:50.682117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b01bc53d-7546-445d-9eff-7a302ecd93e8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:50.959338 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-b01bc53d-7546-445d-9eff-7a302ecd93e8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:50.975906 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b01bc53d-7546-445d-9eff-7a302ecd93e8 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1672 microversion: 2.1 time: 0.312266 May 26 19:47:50.993318 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 468/946] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:50 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1672 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:51.854026 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-0b634b8d-3b53-4953-ba49-ed46bea0c3cc req-43238ec3-6998-4a6a-9a50-26d8f882866e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e438f4b-10f6-4fee-8c25-59798fde83de", "name": "network-vif-deleted", "tag": "28b54a18-eac4-47ed-9cdf-47ca938b6d20"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:47:51.864984 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-0b634b8d-3b53-4953-ba49-ed46bea0c3cc req-43238ec3-6998-4a6a-9a50-26d8f882866e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:51.865701 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-0b634b8d-3b53-4953-ba49-ed46bea0c3cc req-43238ec3-6998-4a6a-9a50-26d8f882866e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:51.880034 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-0b634b8d-3b53-4953-ba49-ed46bea0c3cc req-43238ec3-6998-4a6a-9a50-26d8f882866e service nova] Creating event network-vif-deleted:28b54a18-eac4-47ed-9cdf-47ca938b6d20 for instance 3e438f4b-10f6-4fee-8c25-59798fde83de on hv-cinder-82549 May 26 19:47:51.887110 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-0b634b8d-3b53-4953-ba49-ed46bea0c3cc req-43238ec3-6998-4a6a-9a50-26d8f882866e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.352601 May 26 19:47:51.888248 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 479/947] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:47:51.997604 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:51.998715 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:52.015436 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:52.015886 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:52.017062 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:52.018875 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:52.060312 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:52.061086 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:52.062314 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lazy-loading 'fault' on Instance uuid 3e438f4b-10f6-4fee-8c25-59798fde83de {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:47:52.136177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72991fbdeb3d41e6929ad2d6f3c1aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d58e80c3594ae2abb49ade4482dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:47:52.148109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fb58dca6-dbca-4104-a567-1f91f2e3ed13 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 200 len: 1327 microversion: 2.1 time: 0.157254 May 26 19:47:52.159713 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 469/948] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:51 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:47:53.166328 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:53.167064 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:53.175118 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:53.175622 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:53.176589 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:53.177196 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:53.194332 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] HTTP exception thrown: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Request method failure captured: May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de HTTP/1.1 May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9giH8Y-2dVzXRrkdTSx7ZT72Z6SyYCDY9UggNpa290gYQ4VSm-hNUq6qbx6FoGoRXdpXHB4m_4VQ5xcA20WxOYTbPZdwUGUy5B22u7GqgpjKHXmoSyg8RphuFQU5u8h_Fjxmr9n0YzZ1lgmLPRGyV8C7wl92CD21Be7-buJx1_YBGI May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:47:53.196065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f6d58e80c3594ae2abb49ade4482dfd3", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 72991fbdeb3d41e6929ad2d6f3c1aaf6 May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:53.197753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '3e438f4b-10f6-4fee-8c25-59798fde83de'} May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:53.198711 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:53.200421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:53.201804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Returning 404 to user: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:53.201804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ffb85dd5-99d4-44b4-b403-19500f059e81 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 404 len: 111 microversion: 2.1 time: 0.035397 May 26 19:47:53.201804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 480/949] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:53 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:47:53.206778 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-daf28972-452a-4d0d-98e9-448bd9b51a0a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '.version_select at 0x7fa7881a4dc0>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:53.470196 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-daf28972-452a-4d0d-98e9-448bd9b51a0a tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940810939" status: 202 len: 0 microversion: 2.1 time: 0.266915 May 26 19:47:53.470500 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 470/950] 10.222.0.72 () {58 vars in 1217 bytes} [Thu May 26 19:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940810939 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:47:56.986817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:56.987409 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:56.997250 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:56.997705 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:56.998481 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:56.998938 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:57.013143 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] HTTP exception thrown: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Request method failure captured: May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de HTTP/1.1 May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9giH8Y-2dVzXRrkdTSx7ZT72Z6SyYCDY9UggNpa290gYQ4VSm-hNUq6qbx6FoGoRXdpXHB4m_4VQ5xcA20WxOYTbPZdwUGUy5B22u7GqgpjKHXmoSyg8RphuFQU5u8h_Fjxmr9n0YzZ1lgmLPRGyV8C7wl92CD21Be7-buJx1_YBGI May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:47:57.014979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f6d58e80c3594ae2abb49ade4482dfd3", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 72991fbdeb3d41e6929ad2d6f3c1aaf6 May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.016582 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '3e438f4b-10f6-4fee-8c25-59798fde83de'} May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:57.017494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.019546 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:57.021707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Returning 404 to user: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:57.022556 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6534da99-17f7-4aa9-b7c0-a48c8473830b tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 404 len: 111 microversion: 2.1 time: 0.039701 May 26 19:47:57.023129 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 481/951] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:47:56 2022] DELETE /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 19:47:57.034588 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:57.035836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 3e438f4b-10f6-4fee-8c25-59798fde83de] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:57.044307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:57.044762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:57.045544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:57.045986 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:57.059958 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] HTTP exception thrown: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Request method failure captured: May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de HTTP/1.1 May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9giH8Y-2dVzXRrkdTSx7ZT72Z6SyYCDY9UggNpa290gYQ4VSm-hNUq6qbx6FoGoRXdpXHB4m_4VQ5xcA20WxOYTbPZdwUGUy5B22u7GqgpjKHXmoSyg8RphuFQU5u8h_Fjxmr9n0YzZ1lgmLPRGyV8C7wl92CD21Be7-buJx1_YBGI May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:47:57.061617 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f6d58e80c3594ae2abb49ade4482dfd3", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 72991fbdeb3d41e6929ad2d6f3c1aaf6 May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.063076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '3e438f4b-10f6-4fee-8c25-59798fde83de'} May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:57.063863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. May 26 19:47:57.065168 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:57.066941 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Returning 404 to user: Instance 3e438f4b-10f6-4fee-8c25-59798fde83de could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:57.067951 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b7d6a549-2214-456e-8b97-e3db2ee149e4 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de" status: 404 len: 111 microversion: 2.1 time: 0.039911 May 26 19:47:57.068510 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 471/952] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:57 2022] GET /compute/v2.1/servers/3e438f4b-10f6-4fee-8c25-59798fde83de => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:47:58.365309 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:58.365956 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:58.379761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:58.380360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:58.381208 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:58.381590 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:58.398625 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] HTTP exception thrown: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Request method failure captured: May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: DELETE /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 HTTP/1.1 May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9giH8Y-2dVzXRrkdTSx7ZT72Z6SyYCDY9UggNpa290gYQ4VSm-hNUq6qbx6FoGoRXdpXHB4m_4VQ5xcA20WxOYTbPZdwUGUy5B22u7GqgpjKHXmoSyg8RphuFQU5u8h_Fjxmr9n0YzZ1lgmLPRGyV8C7wl92CD21Be7-buJx1_YBGI May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:47:58.400303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f6d58e80c3594ae2abb49ade4482dfd3", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 72991fbdeb3d41e6929ad2d6f3c1aaf6 May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.401723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '2ae90233-1398-44cd-9ac0-9d660d9b6e64'} May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:58.402583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.404356 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:47:58.406922 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Returning 404 to user: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:58.406922 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e460455d-3a34-4e87-97ad-4eb78b59e35c tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 404 len: 111 microversion: 2.1 time: 0.040338 May 26 19:47:58.406922 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 482/953] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:47:58 2022] DELETE /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:47:58.413268 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:47:58.415258 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] [instance: 2ae90233-1398-44cd-9ac0-9d660d9b6e64] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:47:58.422031 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:58.422777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:58.423871 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:47:58.424381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:47:58.438941 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] HTTP exception thrown: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Request method failure captured: May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 HTTP/1.1 May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9giH8Y-2dVzXRrkdTSx7ZT72Z6SyYCDY9UggNpa290gYQ4VSm-hNUq6qbx6FoGoRXdpXHB4m_4VQ5xcA20WxOYTbPZdwUGUy5B22u7GqgpjKHXmoSyg8RphuFQU5u8h_Fjxmr9n0YzZ1lgmLPRGyV8C7wl92CD21Be7-buJx1_YBGI May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:47:58.441009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f6d58e80c3594ae2abb49ade4482dfd3", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f6d58e80c3594ae2abb49ade4482dfd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: f6d58e80c3594ae2abb49ade4482dfd3 May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-28422270 May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 72991fbdeb3d41e6929ad2d6f3c1aaf6 May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-AttachVolumeTestJSON-28422270-project May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.442420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '2ae90233-1398-44cd-9ac0-9d660d9b6e64'} May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:47:58.443577 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. May 26 19:47:58.444789 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:47:58.445917 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] Returning 404 to user: Instance 2ae90233-1398-44cd-9ac0-9d660d9b6e64 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:47:58.445917 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0cb3e5b1-4d9e-402a-99de-f8a6482f6614 tempest-AttachVolumeTestJSON-28422270 tempest-AttachVolumeTestJSON-28422270-project] 10.222.0.72 "GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64" status: 404 len: 111 microversion: 2.1 time: 0.033017 May 26 19:47:58.445917 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 472/954] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:47:58 2022] GET /compute/v2.1/servers/2ae90233-1398-44cd-9ac0-9d660d9b6e64 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:48:00.444672 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5e85f8cd-b1cf-47e4-a47c-164c717274f6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Action: 'create', calling method: .version_select at 0x7fa7883a7a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1062238906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmcTumBW0zveptLYpP6H8KUO7I0V+pjn6+3TYj5Fp/4C7hhDgUnZNO0LkaTOwrmfrM32wjkGsrTqVNJrRzZ2narqLAxT0XFPMUD1VfGXNLsIqmd+bIHI5Vzq4NHUi8YFw=="}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:00.461395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-5e85f8cd-b1cf-47e4-a47c-164c717274f6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Getting quotas for project f01283b247cc476682b191f71b1d03ed. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:48:00.466001 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-5e85f8cd-b1cf-47e4-a47c-164c717274f6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Getting quotas for user d4f1d06345f8419d84c746a509cab801 and project f01283b247cc476682b191f71b1d03ed. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:48:00.546807 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5e85f8cd-b1cf-47e4-a47c-164c717274f6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.106629 May 26 19:48:00.547466 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 483/955] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:48:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:48:00.597867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1604887494", "imageRef": "c1867002-708d-4a32-9381-be86dd723917", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1062238906", "networks": [{"uuid": "5ebcaeff-c8a3-4c21-9c4f-c35a87d5f50d"}]}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:00.650332 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] validate_networks() for [('5ebcaeff-c8a3-4c21-9c4f-c35a87d5f50d', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:48:01.355993 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:48:01.356416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:48:01.357320 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:48:01.362737 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:48:01.362737 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:48:01.368533 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:01.369244 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:01.370217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:01.370820 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:01.398660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Getting quotas for project f01283b247cc476682b191f71b1d03ed. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:48:01.406669 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Getting quotas for user d4f1d06345f8419d84c746a509cab801 and project f01283b247cc476682b191f71b1d03ed. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:48:01.425777 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:48:01.428896 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1867002-708d-4a32-9381-be86dd723917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:48:01.555255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-a94c7979-39a7-4ad7-bba5-399350ca1a28 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961248 May 26 19:48:01.556247 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 473/956] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:48:01.567184 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c4cec897-2ec1-43d6-a0f8-caefa191ffca tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:01.567910 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c4cec897-2ec1-43d6-a0f8-caefa191ffca tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:01.650602 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c4cec897-2ec1-43d6-a0f8-caefa191ffca tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:01.660970 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c4cec897-2ec1-43d6-a0f8-caefa191ffca tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1259 microversion: 2.1 time: 0.098004 May 26 19:48:01.671284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 484/957] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:01 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1259 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:02.680023 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-90ad7a62-170d-416c-9e81-f8f236b0d52f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:02.680637 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-90ad7a62-170d-416c-9e81-f8f236b0d52f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:02.745710 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-90ad7a62-170d-416c-9e81-f8f236b0d52f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:02.752466 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-90ad7a62-170d-416c-9e81-f8f236b0d52f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1259 microversion: 2.1 time: 0.076803 May 26 19:48:02.753051 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 474/958] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:02 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:03.771208 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-bb20f582-0e60-4c42-8193-0f90a98062fb tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:03.771822 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-bb20f582-0e60-4c42-8193-0f90a98062fb tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:03.778296 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bb20f582-0e60-4c42-8193-0f90a98062fb tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:03.778764 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bb20f582-0e60-4c42-8193-0f90a98062fb tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:03.779607 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bb20f582-0e60-4c42-8193-0f90a98062fb tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:03.780044 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-bb20f582-0e60-4c42-8193-0f90a98062fb tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:03.847523 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-bb20f582-0e60-4c42-8193-0f90a98062fb tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:03.855674 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-bb20f582-0e60-4c42-8193-0f90a98062fb tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1311 microversion: 2.1 time: 0.088327 May 26 19:48:03.856242 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 485/959] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:03 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:04.874090 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-58847ec7-6863-468a-a47a-33a312bc1cb3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:04.874722 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-58847ec7-6863-468a-a47a-33a312bc1cb3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:04.888460 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58847ec7-6863-468a-a47a-33a312bc1cb3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:04.890282 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58847ec7-6863-468a-a47a-33a312bc1cb3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:04.891264 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58847ec7-6863-468a-a47a-33a312bc1cb3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:04.898594 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58847ec7-6863-468a-a47a-33a312bc1cb3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:05.134624 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-58847ec7-6863-468a-a47a-33a312bc1cb3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:05.145662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-58847ec7-6863-468a-a47a-33a312bc1cb3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.276022 May 26 19:48:05.150834 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 475/960] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:04 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:06.172986 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ec1f1f64-b444-43de-a173-950fc687ea97 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:06.175411 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ec1f1f64-b444-43de-a173-950fc687ea97 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:06.179036 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:06.187699 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ec1f1f64-b444-43de-a173-950fc687ea97 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:06.188275 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ec1f1f64-b444-43de-a173-950fc687ea97 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:06.189964 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ec1f1f64-b444-43de-a173-950fc687ea97 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:06.190716 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ec1f1f64-b444-43de-a173-950fc687ea97 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:06.193991 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:06.394614 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ec1f1f64-b444-43de-a173-950fc687ea97 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:06.402882 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ec1f1f64-b444-43de-a173-950fc687ea97 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.236124 May 26 19:48:06.414691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 486/961] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:06 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:06.737101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-fb93650c-8ad6-456e-96da-ccc88553f75f req-5db82384-298d-4468-84d7-c959539d66cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06", "tag": "1dd707d6-81e4-4739-aa53-6af3cd8a7202"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:06.764362 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-fb93650c-8ad6-456e-96da-ccc88553f75f req-5db82384-298d-4468-84d7-c959539d66cd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:06.765070 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-fb93650c-8ad6-456e-96da-ccc88553f75f req-5db82384-298d-4468-84d7-c959539d66cd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:06.790145 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-fb93650c-8ad6-456e-96da-ccc88553f75f req-5db82384-298d-4468-84d7-c959539d66cd service nova] Creating event network-changed:1dd707d6-81e4-4739-aa53-6af3cd8a7202 for instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 on hv-cinder-82549 May 26 19:48:06.796764 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-fb93650c-8ad6-456e-96da-ccc88553f75f req-5db82384-298d-4468-84d7-c959539d66cd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063413 May 26 19:48:06.798105 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 476/962] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:48:07.421679 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1079c863-a792-4229-b5a6-9da9f070ddb7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:07.422279 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1079c863-a792-4229-b5a6-9da9f070ddb7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:07.431054 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1079c863-a792-4229-b5a6-9da9f070ddb7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:07.431747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1079c863-a792-4229-b5a6-9da9f070ddb7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:07.432807 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1079c863-a792-4229-b5a6-9da9f070ddb7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:07.433395 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1079c863-a792-4229-b5a6-9da9f070ddb7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:07.598825 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1079c863-a792-4229-b5a6-9da9f070ddb7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:07.607811 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1079c863-a792-4229-b5a6-9da9f070ddb7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.190114 May 26 19:48:07.608827 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 487/963] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:07 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:08.628914 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7acc9c47-3fb9-4535-8a3b-1c2d40c67af4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:08.630276 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7acc9c47-3fb9-4535-8a3b-1c2d40c67af4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:08.638212 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7acc9c47-3fb9-4535-8a3b-1c2d40c67af4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:08.639098 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7acc9c47-3fb9-4535-8a3b-1c2d40c67af4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:08.643098 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7acc9c47-3fb9-4535-8a3b-1c2d40c67af4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:08.643098 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7acc9c47-3fb9-4535-8a3b-1c2d40c67af4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:08.794384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7acc9c47-3fb9-4535-8a3b-1c2d40c67af4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:08.805843 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7acc9c47-3fb9-4535-8a3b-1c2d40c67af4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.183964 May 26 19:48:08.806439 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 477/964] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:08 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:09.822692 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-da470e1f-728e-4d91-98d5-ca8010d2898d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:09.823309 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-da470e1f-728e-4d91-98d5-ca8010d2898d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:09.830424 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-da470e1f-728e-4d91-98d5-ca8010d2898d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:09.830862 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-da470e1f-728e-4d91-98d5-ca8010d2898d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:09.831637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-da470e1f-728e-4d91-98d5-ca8010d2898d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:09.832199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-da470e1f-728e-4d91-98d5-ca8010d2898d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:09.987494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-da470e1f-728e-4d91-98d5-ca8010d2898d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:10.001077 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-da470e1f-728e-4d91-98d5-ca8010d2898d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.182099 May 26 19:48:10.002525 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 488/965] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:09 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:11.025389 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1d57bf22-30ed-4fe9-87cb-7dd870b1a674 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:11.025389 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1d57bf22-30ed-4fe9-87cb-7dd870b1a674 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:11.027460 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d57bf22-30ed-4fe9-87cb-7dd870b1a674 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:11.027913 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d57bf22-30ed-4fe9-87cb-7dd870b1a674 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:11.028685 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d57bf22-30ed-4fe9-87cb-7dd870b1a674 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:11.029120 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1d57bf22-30ed-4fe9-87cb-7dd870b1a674 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:11.190354 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1d57bf22-30ed-4fe9-87cb-7dd870b1a674 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:11.198597 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1d57bf22-30ed-4fe9-87cb-7dd870b1a674 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.182784 May 26 19:48:11.199201 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 478/966] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:11 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:12.216155 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-19ac84a2-43b4-4ac8-bac1-5dfad9a8e73c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:12.216761 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-19ac84a2-43b4-4ac8-bac1-5dfad9a8e73c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:12.219123 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=6 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:12.224747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-19ac84a2-43b4-4ac8-bac1-5dfad9a8e73c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:12.225193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-19ac84a2-43b4-4ac8-bac1-5dfad9a8e73c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:12.225956 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-19ac84a2-43b4-4ac8-bac1-5dfad9a8e73c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:12.226382 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-19ac84a2-43b4-4ac8-bac1-5dfad9a8e73c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:12.358921 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-19ac84a2-43b4-4ac8-bac1-5dfad9a8e73c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:12.367703 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-19ac84a2-43b4-4ac8-bac1-5dfad9a8e73c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.155438 May 26 19:48:12.369490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 489/967] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:12 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:48:13.385537 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4fea3c5c-f933-413e-b3b8-cbc7a307ecaf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:13.387924 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4fea3c5c-f933-413e-b3b8-cbc7a307ecaf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:13.388184 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:13.388885 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=8 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:13.389511 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:13.394879 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fea3c5c-f933-413e-b3b8-cbc7a307ecaf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:13.395350 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fea3c5c-f933-413e-b3b8-cbc7a307ecaf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:13.396102 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fea3c5c-f933-413e-b3b8-cbc7a307ecaf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:13.396535 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4fea3c5c-f933-413e-b3b8-cbc7a307ecaf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:13.399087 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:13.525283 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4fea3c5c-f933-413e-b3b8-cbc7a307ecaf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:13.532783 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4fea3c5c-f933-413e-b3b8-cbc7a307ecaf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.151379 May 26 19:48:13.533934 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 479/968] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:13 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:14.549875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-5f0b25de-4d3e-43e2-b49c-11aad88f55d4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:14.550504 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-5f0b25de-4d3e-43e2-b49c-11aad88f55d4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:14.557019 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f0b25de-4d3e-43e2-b49c-11aad88f55d4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:14.557470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f0b25de-4d3e-43e2-b49c-11aad88f55d4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:14.558222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f0b25de-4d3e-43e2-b49c-11aad88f55d4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:14.558653 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-5f0b25de-4d3e-43e2-b49c-11aad88f55d4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:14.694303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-5f0b25de-4d3e-43e2-b49c-11aad88f55d4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:14.701805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-5f0b25de-4d3e-43e2-b49c-11aad88f55d4 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.155957 May 26 19:48:14.702369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 490/969] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:14 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:15.724224 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-58bc66f3-cd31-440a-854e-91ffb9b5510d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:15.724224 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-58bc66f3-cd31-440a-854e-91ffb9b5510d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:15.727946 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58bc66f3-cd31-440a-854e-91ffb9b5510d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:15.728379 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58bc66f3-cd31-440a-854e-91ffb9b5510d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:15.729151 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58bc66f3-cd31-440a-854e-91ffb9b5510d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:15.729590 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58bc66f3-cd31-440a-854e-91ffb9b5510d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:15.862093 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-58bc66f3-cd31-440a-854e-91ffb9b5510d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:15.869563 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-58bc66f3-cd31-440a-854e-91ffb9b5510d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.155046 May 26 19:48:15.870170 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 480/970] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:15 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:16.889036 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c9482058-fe82-4ad2-a996-0ea3cf4d628d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:16.889630 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c9482058-fe82-4ad2-a996-0ea3cf4d628d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:16.896079 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c9482058-fe82-4ad2-a996-0ea3cf4d628d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:16.896558 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c9482058-fe82-4ad2-a996-0ea3cf4d628d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:16.897319 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c9482058-fe82-4ad2-a996-0ea3cf4d628d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:16.897753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c9482058-fe82-4ad2-a996-0ea3cf4d628d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:17.030825 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c9482058-fe82-4ad2-a996-0ea3cf4d628d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:17.037650 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c9482058-fe82-4ad2-a996-0ea3cf4d628d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.152548 May 26 19:48:17.038221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 491/971] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:16 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:18.055668 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fca5f5e0-375f-4d66-907a-879eaaa708c2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:18.056273 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fca5f5e0-375f-4d66-907a-879eaaa708c2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:18.062712 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fca5f5e0-375f-4d66-907a-879eaaa708c2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:18.063181 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fca5f5e0-375f-4d66-907a-879eaaa708c2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:18.063929 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fca5f5e0-375f-4d66-907a-879eaaa708c2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:18.064963 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fca5f5e0-375f-4d66-907a-879eaaa708c2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:18.195813 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fca5f5e0-375f-4d66-907a-879eaaa708c2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:18.204836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fca5f5e0-375f-4d66-907a-879eaaa708c2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.153324 May 26 19:48:18.205540 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 481/972] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:18 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:19.227035 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6d787759-c61e-4fa8-83b7-2293acbfe370 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:19.227630 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6d787759-c61e-4fa8-83b7-2293acbfe370 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:19.234137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6d787759-c61e-4fa8-83b7-2293acbfe370 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:19.234579 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6d787759-c61e-4fa8-83b7-2293acbfe370 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:19.235390 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6d787759-c61e-4fa8-83b7-2293acbfe370 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:19.235827 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6d787759-c61e-4fa8-83b7-2293acbfe370 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:19.256753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-39e5d8ce-4a14-4804-89cc-08eeab8ff44e req-b5c792b3-16fc-4184-a9b0-ac22b8e1728a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06", "name": "network-vif-plugged", "status": "completed", "tag": "1dd707d6-81e4-4739-aa53-6af3cd8a7202"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:19.264800 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-39e5d8ce-4a14-4804-89cc-08eeab8ff44e req-b5c792b3-16fc-4184-a9b0-ac22b8e1728a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:19.265237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-39e5d8ce-4a14-4804-89cc-08eeab8ff44e req-b5c792b3-16fc-4184-a9b0-ac22b8e1728a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:19.284178 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-39e5d8ce-4a14-4804-89cc-08eeab8ff44e req-b5c792b3-16fc-4184-a9b0-ac22b8e1728a service nova] Creating event network-vif-plugged:1dd707d6-81e4-4739-aa53-6af3cd8a7202 for instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 on hv-cinder-82549 May 26 19:48:19.288206 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-39e5d8ce-4a14-4804-89cc-08eeab8ff44e req-b5c792b3-16fc-4184-a9b0-ac22b8e1728a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151651 May 26 19:48:19.288807 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 492/973] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:48:19.395476 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6d787759-c61e-4fa8-83b7-2293acbfe370 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:19.403071 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6d787759-c61e-4fa8-83b7-2293acbfe370 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.179995 May 26 19:48:19.403712 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 482/974] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:19 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:48:20.420844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0acaf430-c5e8-4273-8263-f9367f684df0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:20.421535 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0acaf430-c5e8-4273-8263-f9367f684df0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:20.429429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0acaf430-c5e8-4273-8263-f9367f684df0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:20.430320 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0acaf430-c5e8-4273-8263-f9367f684df0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:20.431352 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0acaf430-c5e8-4273-8263-f9367f684df0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:20.431958 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0acaf430-c5e8-4273-8263-f9367f684df0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:20.566503 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0acaf430-c5e8-4273-8263-f9367f684df0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:20.574146 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0acaf430-c5e8-4273-8263-f9367f684df0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1359 microversion: 2.1 time: 0.157565 May 26 19:48:20.574804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 493/975] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:20 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:21.591560 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-58e20f57-5c58-44b4-882a-a88aa1530ce3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:21.592266 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-58e20f57-5c58-44b4-882a-a88aa1530ce3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:21.599890 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58e20f57-5c58-44b4-882a-a88aa1530ce3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:21.599995 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58e20f57-5c58-44b4-882a-a88aa1530ce3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:21.600868 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58e20f57-5c58-44b4-882a-a88aa1530ce3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:21.601367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-58e20f57-5c58-44b4-882a-a88aa1530ce3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:21.734765 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-58e20f57-5c58-44b4-882a-a88aa1530ce3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:21.742827 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-58e20f57-5c58-44b4-882a-a88aa1530ce3 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1549 microversion: 2.1 time: 0.155477 May 26 19:48:21.743435 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 483/976] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:21 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:21.759664 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c26e6417-7816-42d2-8f81-4871051b816a tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:21.760296 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c26e6417-7816-42d2-8f81-4871051b816a tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:21.767225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c26e6417-7816-42d2-8f81-4871051b816a tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:21.767682 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c26e6417-7816-42d2-8f81-4871051b816a tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:21.768487 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c26e6417-7816-42d2-8f81-4871051b816a tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:21.768950 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c26e6417-7816-42d2-8f81-4871051b816a tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:21.922299 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c26e6417-7816-42d2-8f81-4871051b816a tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:21.930518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c26e6417-7816-42d2-8f81-4871051b816a tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1549 microversion: 2.1 time: 0.174770 May 26 19:48:21.933448 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 494/977] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:21 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:21.946620 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-555bbe8e-ab8d-48b5-b44a-3d8d3ac81d4f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:21.950077 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-555bbe8e-ab8d-48b5-b44a-3d8d3ac81d4f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:21.950867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-555bbe8e-ab8d-48b5-b44a-3d8d3ac81d4f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Searching by: {'deleted': False, 'project_id': 'f01283b247cc476682b191f71b1d03ed'} {{(pid=124877) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 19:48:21.957486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-555bbe8e-ab8d-48b5-b44a-3d8d3ac81d4f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:21.957964 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-555bbe8e-ab8d-48b5-b44a-3d8d3ac81d4f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:21.962115 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-555bbe8e-ab8d-48b5-b44a-3d8d3ac81d4f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:21.962115 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-555bbe8e-ab8d-48b5-b44a-3d8d3ac81d4f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:22.051454 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.multi_cell_list [None req-555bbe8e-ab8d-48b5-b44a-3d8d3ac81d4f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124877) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 19:48:22.145390 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-555bbe8e-ab8d-48b5-b44a-3d8d3ac81d4f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202461 May 26 19:48:22.146129 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 484/978] 10.222.0.72 () {58 vars in 1124 bytes} [Thu May 26 19:48:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:48:22.156302 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-00849f37-94e1-4da6-a054-2e1cda6d63cc tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:22.156911 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-00849f37-94e1-4da6-a054-2e1cda6d63cc tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:22.164597 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-00849f37-94e1-4da6-a054-2e1cda6d63cc tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:22.165052 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-00849f37-94e1-4da6-a054-2e1cda6d63cc tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:22.165823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-00849f37-94e1-4da6-a054-2e1cda6d63cc tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:22.166480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-00849f37-94e1-4da6-a054-2e1cda6d63cc tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:22.306306 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-00849f37-94e1-4da6-a054-2e1cda6d63cc tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:22.313946 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-00849f37-94e1-4da6-a054-2e1cda6d63cc tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1549 microversion: 2.1 time: 0.161337 May 26 19:48:22.314552 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 495/979] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:22 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:24.245653 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e8edc9f9-8ff3-43e2-a0f1-e8a9d7e8468c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "506d124e-0db9-401e-8a67-fe3a815b0d7b"}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:24.247001 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e8edc9f9-8ff3-43e2-a0f1-e8a9d7e8468c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:24.253719 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e8edc9f9-8ff3-43e2-a0f1-e8a9d7e8468c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:24.254169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e8edc9f9-8ff3-43e2-a0f1-e8a9d7e8468c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:24.254945 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e8edc9f9-8ff3-43e2-a0f1-e8a9d7e8468c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:24.255384 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e8edc9f9-8ff3-43e2-a0f1-e8a9d7e8468c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:25.131359 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e8edc9f9-8ff3-43e2-a0f1-e8a9d7e8468c tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "POST /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889576 May 26 19:48:25.131997 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 485/980] 10.222.0.72 () {60 vars in 1322 bytes} [Thu May 26 19:48:24 2022] POST /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:48:32.692986 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-17908788-ed72-46f7-9797-c05a2e8a9163 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:32.693595 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-17908788-ed72-46f7-9797-c05a2e8a9163 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:32.695881 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=19 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:32.696586 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=55 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:32.701266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-17908788-ed72-46f7-9797-c05a2e8a9163 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:32.701713 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-17908788-ed72-46f7-9797-c05a2e8a9163 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:32.702467 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-17908788-ed72-46f7-9797-c05a2e8a9163 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:32.702925 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-17908788-ed72-46f7-9797-c05a2e8a9163 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:32.835044 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-17908788-ed72-46f7-9797-c05a2e8a9163 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:32.843092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-17908788-ed72-46f7-9797-c05a2e8a9163 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1595 microversion: 2.1 time: 0.154619 May 26 19:48:32.845306 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 496/981] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:32 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:35.257553 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:35.261823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=13 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:35.261823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:35.263875 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-33f6f0a9-2ee6-4648-b66b-2e1c0fe15059 req-8beefb65-8240-4bcf-9943-4df482be15eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06", "tag": "1dd707d6-81e4-4739-aa53-6af3cd8a7202"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:35.273969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-33f6f0a9-2ee6-4648-b66b-2e1c0fe15059 req-8beefb65-8240-4bcf-9943-4df482be15eb service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:35.274549 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-33f6f0a9-2ee6-4648-b66b-2e1c0fe15059 req-8beefb65-8240-4bcf-9943-4df482be15eb service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:35.286462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-33f6f0a9-2ee6-4648-b66b-2e1c0fe15059 req-8beefb65-8240-4bcf-9943-4df482be15eb service nova] Creating event network-changed:1dd707d6-81e4-4739-aa53-6af3cd8a7202 for instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 on hv-cinder-82549 May 26 19:48:35.291939 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-33f6f0a9-2ee6-4648-b66b-2e1c0fe15059 req-8beefb65-8240-4bcf-9943-4df482be15eb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035642 May 26 19:48:35.292632 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 486/982] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:48:37.058842 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-907214323", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "networks": [{"uuid": "12bedc7a-092f-46b2-9ceb-bac7f427ce8b"}]}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:37.109783 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.network.neutron [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] validate_networks() for [('12bedc7a-092f-46b2-9ceb-bac7f427ce8b', None, None, None, None, None)] {{(pid=124876) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:48:37.502958 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Flavor limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:48:37.503380 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Image limits 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:48:37.504186 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Flavor pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:48:37.504598 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Image pref 0:0:0 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:48:37.505066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.virt.hardware [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:48:37.513815 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:37.514423 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:37.515286 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:37.515721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:37.532709 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Getting quotas for project 826fe966558845f28e787f440f26b2a5. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:48:37.537344 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Getting quotas for user 0963bc628fbc453ab09dce6c5f3321bb and project 826fe966558845f28e787f440f26b2a5. Resources: {'cores', 'instances', 'ram'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:48:37.548269 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Going to run 1 instances... {{(pid=124876) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:48:37.551478 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:48:37.731134 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6212c4d0-d526-49ad-95ab-7c69064ab2fb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676129 May 26 19:48:37.731768 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 497/983] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:48:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:48:37.748606 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-568db074-feb4-46e6-9687-7a55700bf70c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:37.749290 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-568db074-feb4-46e6-9687-7a55700bf70c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:37.820728 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-568db074-feb4-46e6-9687-7a55700bf70c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:37.829117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-568db074-feb4-46e6-9687-7a55700bf70c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1213 microversion: 2.1 time: 0.085770 May 26 19:48:37.831127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 487/984] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:37 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:38.088421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a0dce602-28a4-42bf-b6a3-626693d38c03 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1243511219"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:38.089004 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a0dce602-28a4-42bf-b6a3-626693d38c03 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:38.095020 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a0dce602-28a4-42bf-b6a3-626693d38c03 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:38.095470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a0dce602-28a4-42bf-b6a3-626693d38c03 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:38.096230 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a0dce602-28a4-42bf-b6a3-626693d38c03 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:38.096658 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a0dce602-28a4-42bf-b6a3-626693d38c03 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:38.224424 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.network.security_group_api [None req-a0dce602-28a4-42bf-b6a3-626693d38c03 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Adding security group f4987430-f9db-4539-b262-ce7b99282158 to port 1dd707d6-81e4-4739-aa53-6af3cd8a7202 May 26 19:48:38.847147 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3012df7d-9ec2-4fd7-a311-0deec9ac0f53 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:38.847747 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3012df7d-9ec2-4fd7-a311-0deec9ac0f53 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:38.900737 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3012df7d-9ec2-4fd7-a311-0deec9ac0f53 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:38.912326 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3012df7d-9ec2-4fd7-a311-0deec9ac0f53 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1213 microversion: 2.1 time: 0.069367 May 26 19:48:38.913134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 488/985] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:38 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 19:48:38.955983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a0dce602-28a4-42bf-b6a3-626693d38c03 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "POST /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/action" status: 202 len: 0 microversion: 2.1 time: 0.871768 May 26 19:48:38.959900 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 498/986] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:48:38 2022] POST /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/action => generated 0 bytes in 874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:48:38.973075 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f5a66d2f-c421-498b-a8eb-e5b4f9f75335 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:38.973682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f5a66d2f-c421-498b-a8eb-e5b4f9f75335 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:38.983438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f5a66d2f-c421-498b-a8eb-e5b4f9f75335 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:38.984218 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f5a66d2f-c421-498b-a8eb-e5b4f9f75335 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:38.985235 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f5a66d2f-c421-498b-a8eb-e5b4f9f75335 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:38.985886 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f5a66d2f-c421-498b-a8eb-e5b4f9f75335 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:39.184197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f5a66d2f-c421-498b-a8eb-e5b4f9f75335 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:39.198579 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f5a66d2f-c421-498b-a8eb-e5b4f9f75335 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1760 microversion: 2.1 time: 0.237183 May 26 19:48:39.211992 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 489/987] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:38 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1760 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:39.223285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-809f4882-a8d0-4a47-b7a3-376444352bf4 req-a48d828d-6192-4ee6-9738-3908f28fd568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06", "tag": "1dd707d6-81e4-4739-aa53-6af3cd8a7202"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:39.231743 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-809f4882-a8d0-4a47-b7a3-376444352bf4 req-a48d828d-6192-4ee6-9738-3908f28fd568 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:39.232394 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-809f4882-a8d0-4a47-b7a3-376444352bf4 req-a48d828d-6192-4ee6-9738-3908f28fd568 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:39.245274 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-809f4882-a8d0-4a47-b7a3-376444352bf4 req-a48d828d-6192-4ee6-9738-3908f28fd568 service nova] Creating event network-changed:1dd707d6-81e4-4739-aa53-6af3cd8a7202 for instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 on hv-cinder-82549 May 26 19:48:39.252533 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-809f4882-a8d0-4a47-b7a3-376444352bf4 req-a48d828d-6192-4ee6-9738-3908f28fd568 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287643 May 26 19:48:39.258738 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 499/988] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:48:39.930060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-54135d37-1baf-40e0-aa7b-dd0ad18d92df tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:39.930955 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-54135d37-1baf-40e0-aa7b-dd0ad18d92df tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:39.937206 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-54135d37-1baf-40e0-aa7b-dd0ad18d92df tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:39.937657 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-54135d37-1baf-40e0-aa7b-dd0ad18d92df tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:39.938998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-54135d37-1baf-40e0-aa7b-dd0ad18d92df tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:39.939493 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-54135d37-1baf-40e0-aa7b-dd0ad18d92df tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:40.018690 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-54135d37-1baf-40e0-aa7b-dd0ad18d92df tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:40.026169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-54135d37-1baf-40e0-aa7b-dd0ad18d92df tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1265 microversion: 2.1 time: 0.100046 May 26 19:48:40.027130 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 490/989] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:39 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:41.043717 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-cf98f2cf-dbbc-4ffa-9e73-cc9e2e788e37 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:41.044405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-cf98f2cf-dbbc-4ffa-9e73-cc9e2e788e37 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:41.051742 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cf98f2cf-dbbc-4ffa-9e73-cc9e2e788e37 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:41.052191 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cf98f2cf-dbbc-4ffa-9e73-cc9e2e788e37 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:41.052952 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cf98f2cf-dbbc-4ffa-9e73-cc9e2e788e37 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:41.053386 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-cf98f2cf-dbbc-4ffa-9e73-cc9e2e788e37 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:41.185547 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-cf98f2cf-dbbc-4ffa-9e73-cc9e2e788e37 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:41.193550 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-cf98f2cf-dbbc-4ffa-9e73-cc9e2e788e37 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1313 microversion: 2.1 time: 0.154001 May 26 19:48:41.194156 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 500/990] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:41 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:41.947900 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-423d2509-b624-4411-a346-2b705f4a3f9c req-b84312ea-26b5-4002-b6e3-62e3e46497e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac407afa-dd72-47a1-80df-6fdd04026cc4", "tag": "9aab7f42-442a-4c7c-990a-ff9b4418e897"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:41.956566 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-423d2509-b624-4411-a346-2b705f4a3f9c req-b84312ea-26b5-4002-b6e3-62e3e46497e3 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:41.957014 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-423d2509-b624-4411-a346-2b705f4a3f9c req-b84312ea-26b5-4002-b6e3-62e3e46497e3 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:41.967734 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-423d2509-b624-4411-a346-2b705f4a3f9c req-b84312ea-26b5-4002-b6e3-62e3e46497e3 service nova] Creating event network-changed:9aab7f42-442a-4c7c-990a-ff9b4418e897 for instance ac407afa-dd72-47a1-80df-6fdd04026cc4 on hv-cinder-82549 May 26 19:48:41.972743 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-423d2509-b624-4411-a346-2b705f4a3f9c req-b84312ea-26b5-4002-b6e3-62e3e46497e3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028805 May 26 19:48:41.973572 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 491/991] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:48:42.210171 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-30f06438-0466-4b6a-9e78-6970c4331ece tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:42.210739 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-30f06438-0466-4b6a-9e78-6970c4331ece tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:42.217147 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-30f06438-0466-4b6a-9e78-6970c4331ece tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:42.224520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-30f06438-0466-4b6a-9e78-6970c4331ece tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:42.224520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-30f06438-0466-4b6a-9e78-6970c4331ece tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:42.224520 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-30f06438-0466-4b6a-9e78-6970c4331ece tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:42.355365 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-30f06438-0466-4b6a-9e78-6970c4331ece tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:42.366284 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-30f06438-0466-4b6a-9e78-6970c4331ece tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1313 microversion: 2.1 time: 0.160047 May 26 19:48:42.367121 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 501/992] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:42 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:43.385268 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-76d7f7df-55d3-4e80-a428-dee9f72ae9e2 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:43.385990 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-76d7f7df-55d3-4e80-a428-dee9f72ae9e2 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:43.392316 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-76d7f7df-55d3-4e80-a428-dee9f72ae9e2 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:43.392771 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-76d7f7df-55d3-4e80-a428-dee9f72ae9e2 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:43.393525 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-76d7f7df-55d3-4e80-a428-dee9f72ae9e2 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:43.394011 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-76d7f7df-55d3-4e80-a428-dee9f72ae9e2 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:43.525636 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-76d7f7df-55d3-4e80-a428-dee9f72ae9e2 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:43.533063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-76d7f7df-55d3-4e80-a428-dee9f72ae9e2 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1313 microversion: 2.1 time: 0.152514 May 26 19:48:43.533641 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 492/993] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:43 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:44.549753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f1704217-afe7-45c5-bc66-741c73175c08 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:44.550426 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f1704217-afe7-45c5-bc66-741c73175c08 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:44.556883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f1704217-afe7-45c5-bc66-741c73175c08 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:44.557339 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f1704217-afe7-45c5-bc66-741c73175c08 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:44.558094 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f1704217-afe7-45c5-bc66-741c73175c08 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:44.558526 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f1704217-afe7-45c5-bc66-741c73175c08 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:44.683059 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f1704217-afe7-45c5-bc66-741c73175c08 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:44.690592 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f1704217-afe7-45c5-bc66-741c73175c08 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1313 microversion: 2.1 time: 0.144647 May 26 19:48:44.691723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 502/994] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:44 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:45.709355 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d8f04c65-fe75-4486-843d-f3d5ee522bc8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:45.709999 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d8f04c65-fe75-4486-843d-f3d5ee522bc8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:45.716497 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8f04c65-fe75-4486-843d-f3d5ee522bc8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:45.716941 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8f04c65-fe75-4486-843d-f3d5ee522bc8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:45.717687 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8f04c65-fe75-4486-843d-f3d5ee522bc8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:45.718117 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d8f04c65-fe75-4486-843d-f3d5ee522bc8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:45.842611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d8f04c65-fe75-4486-843d-f3d5ee522bc8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:45.850496 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d8f04c65-fe75-4486-843d-f3d5ee522bc8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1313 microversion: 2.1 time: 0.145134 May 26 19:48:45.851083 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 493/995] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:45 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:46.867823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9919b66c-6793-493e-bcd6-9a8ba57a6a7e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:46.868429 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9919b66c-6793-493e-bcd6-9a8ba57a6a7e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:46.875227 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9919b66c-6793-493e-bcd6-9a8ba57a6a7e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:46.875682 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9919b66c-6793-493e-bcd6-9a8ba57a6a7e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:46.876439 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9919b66c-6793-493e-bcd6-9a8ba57a6a7e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:46.876873 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9919b66c-6793-493e-bcd6-9a8ba57a6a7e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:47.013958 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9919b66c-6793-493e-bcd6-9a8ba57a6a7e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:47.021955 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9919b66c-6793-493e-bcd6-9a8ba57a6a7e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1313 microversion: 2.1 time: 0.158032 May 26 19:48:47.022528 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 503/996] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:46 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:47.224857 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-efff8fac-bd9b-4d7c-afd5-b39b6f6952d1 req-51143a17-7f1d-4b77-980c-9e678a3c1ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac407afa-dd72-47a1-80df-6fdd04026cc4", "name": "network-vif-plugged", "status": "completed", "tag": "9aab7f42-442a-4c7c-990a-ff9b4418e897"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:47.240245 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-efff8fac-bd9b-4d7c-afd5-b39b6f6952d1 req-51143a17-7f1d-4b77-980c-9e678a3c1ad1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:47.240701 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-efff8fac-bd9b-4d7c-afd5-b39b6f6952d1 req-51143a17-7f1d-4b77-980c-9e678a3c1ad1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:47.254817 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-efff8fac-bd9b-4d7c-afd5-b39b6f6952d1 req-51143a17-7f1d-4b77-980c-9e678a3c1ad1 service nova] Creating event network-vif-plugged:9aab7f42-442a-4c7c-990a-ff9b4418e897 for instance ac407afa-dd72-47a1-80df-6fdd04026cc4 on hv-cinder-82549 May 26 19:48:47.259910 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-efff8fac-bd9b-4d7c-afd5-b39b6f6952d1 req-51143a17-7f1d-4b77-980c-9e678a3c1ad1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039303 May 26 19:48:47.260510 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 494/997] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:48:48.038644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ee7e4371-f354-457b-a796-bd3c1aaceef7 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:48.039276 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ee7e4371-f354-457b-a796-bd3c1aaceef7 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:48.041221 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:48.041878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=6 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:48.047179 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4371-f354-457b-a796-bd3c1aaceef7 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:48.054940 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4371-f354-457b-a796-bd3c1aaceef7 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:48.054940 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4371-f354-457b-a796-bd3c1aaceef7 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:48.054940 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4371-f354-457b-a796-bd3c1aaceef7 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:48.174888 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ee7e4371-f354-457b-a796-bd3c1aaceef7 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:48.182803 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ee7e4371-f354-457b-a796-bd3c1aaceef7 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1313 microversion: 2.1 time: 0.148048 May 26 19:48:48.183391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 504/998] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:48 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:49.197320 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=4 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:49.201506 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c3da43c1-0ab5-4cb9-83d0-046415356892 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:49.202486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c3da43c1-0ab5-4cb9-83d0-046415356892 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:49.208388 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3da43c1-0ab5-4cb9-83d0-046415356892 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:49.208839 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3da43c1-0ab5-4cb9-83d0-046415356892 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:49.209602 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3da43c1-0ab5-4cb9-83d0-046415356892 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:49.210039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3da43c1-0ab5-4cb9-83d0-046415356892 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:49.346546 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c3da43c1-0ab5-4cb9-83d0-046415356892 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:49.354678 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c3da43c1-0ab5-4cb9-83d0-046415356892 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1313 microversion: 2.1 time: 0.158867 May 26 19:48:49.355369 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 495/999] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:49 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:50.372421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-01fffb8d-1a0a-43a6-a4cc-d682bd747696 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:50.373023 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-01fffb8d-1a0a-43a6-a4cc-d682bd747696 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:50.380297 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01fffb8d-1a0a-43a6-a4cc-d682bd747696 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:50.380781 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01fffb8d-1a0a-43a6-a4cc-d682bd747696 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:50.381549 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01fffb8d-1a0a-43a6-a4cc-d682bd747696 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:50.381983 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-01fffb8d-1a0a-43a6-a4cc-d682bd747696 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:50.517691 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-01fffb8d-1a0a-43a6-a4cc-d682bd747696 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:50.525978 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-01fffb8d-1a0a-43a6-a4cc-d682bd747696 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1497 microversion: 2.1 time: 0.157684 May 26 19:48:50.526558 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 505/1000] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:50 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:51.333334 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3c4d513d-cd47-4518-96bf-86a22c134337 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:51.333860 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3c4d513d-cd47-4518-96bf-86a22c134337 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:51.340231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3c4d513d-cd47-4518-96bf-86a22c134337 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:51.340674 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3c4d513d-cd47-4518-96bf-86a22c134337 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:51.341426 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3c4d513d-cd47-4518-96bf-86a22c134337 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:51.341857 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3c4d513d-cd47-4518-96bf-86a22c134337 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:51.368980 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3c4d513d-cd47-4518-96bf-86a22c134337 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:48:51.669281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3c4d513d-cd47-4518-96bf-86a22c134337 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 204 len: 0 microversion: 2.1 time: 0.340178 May 26 19:48:51.669795 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 496/1001] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:48:51 2022] DELETE /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:48:51.678593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0496d614-6959-41f3-9915-76d905865628 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:51.679242 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0496d614-6959-41f3-9915-76d905865628 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:51.685704 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0496d614-6959-41f3-9915-76d905865628 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:51.686154 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0496d614-6959-41f3-9915-76d905865628 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:51.686937 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0496d614-6959-41f3-9915-76d905865628 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:51.687378 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0496d614-6959-41f3-9915-76d905865628 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:51.821861 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0496d614-6959-41f3-9915-76d905865628 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:51.829307 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0496d614-6959-41f3-9915-76d905865628 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1503 microversion: 2.1 time: 0.155171 May 26 19:48:51.829880 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 506/1002] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:51 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:52.847738 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-8de83b3c-dba6-4f50-9b28-8d67203bd6cc tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:52.848428 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-8de83b3c-dba6-4f50-9b28-8d67203bd6cc tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:52.854866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8de83b3c-dba6-4f50-9b28-8d67203bd6cc tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:52.855341 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8de83b3c-dba6-4f50-9b28-8d67203bd6cc tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:52.856095 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8de83b3c-dba6-4f50-9b28-8d67203bd6cc tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:52.856530 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-8de83b3c-dba6-4f50-9b28-8d67203bd6cc tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:52.983515 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-8de83b3c-dba6-4f50-9b28-8d67203bd6cc tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:52.991104 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-8de83b3c-dba6-4f50-9b28-8d67203bd6cc tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1503 microversion: 2.1 time: 0.148087 May 26 19:48:52.991671 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 497/1003] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:52 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:53.655819 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-8cff8676-a594-4970-938c-7895f9c75f4e req-95df7244-8da9-4789-b5e2-e704c22e95ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac407afa-dd72-47a1-80df-6fdd04026cc4", "name": "network-vif-deleted", "tag": "9aab7f42-442a-4c7c-990a-ff9b4418e897"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:53.664688 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-8cff8676-a594-4970-938c-7895f9c75f4e req-95df7244-8da9-4789-b5e2-e704c22e95ff service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:53.665124 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-8cff8676-a594-4970-938c-7895f9c75f4e req-95df7244-8da9-4789-b5e2-e704c22e95ff service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:53.676497 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-8cff8676-a594-4970-938c-7895f9c75f4e req-95df7244-8da9-4789-b5e2-e704c22e95ff service nova] Creating event network-vif-deleted:9aab7f42-442a-4c7c-990a-ff9b4418e897 for instance ac407afa-dd72-47a1-80df-6fdd04026cc4 on hv-cinder-82549 May 26 19:48:53.681419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-8cff8676-a594-4970-938c-7895f9c75f4e req-95df7244-8da9-4789-b5e2-e704c22e95ff service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029271 May 26 19:48:53.682004 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 507/1004] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:48:54.008810 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:54.009429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:54.015865 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:54.016318 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:54.017081 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:54.017521 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:54.047343 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:54.047793 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:54.048238 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lazy-loading 'fault' on Instance uuid ac407afa-dd72-47a1-80df-6fdd04026cc4 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:48:54.089599 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:54.097614 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-dff2e161-e735-4cde-b605-7c3a610c7cef tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 200 len: 1303 microversion: 2.1 time: 0.092761 May 26 19:48:54.098198 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 498/1005] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:54 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:55.116276 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:55.116956 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ac407afa-dd72-47a1-80df-6fdd04026cc4] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:55.123402 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:55.123841 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:55.124593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:55.125049 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:55.137888 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] HTTP exception thrown: Instance ac407afa-dd72-47a1-80df-6fdd04026cc4 could not be found. May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Request method failure captured: May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 HTTP/1.1 May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9mS4icT4uAmfLIK39iGsgHYUxZmngViH5_djhzxW_rnH9lwW1Sx5Eqr7tMq8ix6GwXvgfozN8MlYJPZ-IHdqqrEipaYFdyKkr4qC7ycBPm1mA6m1C2dAmvg73CQEFOQpFrjXoDJuIzcwKSbZrPRG690cLcqpaNHhg5_IAIak0gWzVA May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: 826fe966558845f28e787f440f26b2a5 May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-VolumesActionsTest-98648486 May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:48:55.139490 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fe966558845f28e787f440f26b2a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fe966558845f28e787f440f26b2a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fe966558845f28e787f440f26b2a5", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fe966558845f28e787f440f26b2a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-VolumesActionsTest-98648486 May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: 826fe966558845f28e787f440f26b2a5 May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-VolumesActionsTest-98648486 May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-VolumesActionsTest-98648486-project May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: 0963bc628fbc453ab09dce6c5f3321bb May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-VolumesActionsTest-98648486-project May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance ac407afa-dd72-47a1-80df-6fdd04026cc4 could not be found. May 26 19:48:55.141237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': 'ac407afa-dd72-47a1-80df-6fdd04026cc4'} May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac407afa-dd72-47a1-80df-6fdd04026cc4 could not be found. May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:48:55.142419 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac407afa-dd72-47a1-80df-6fdd04026cc4 could not be found. May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac407afa-dd72-47a1-80df-6fdd04026cc4 could not be found. May 26 19:48:55.144058 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:48:55.145462 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Returning 404 to user: Instance ac407afa-dd72-47a1-80df-6fdd04026cc4 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:48:55.145462 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-962ebe65-2c23-41f3-be92-50e26255204a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4" status: 404 len: 111 microversion: 2.1 time: 0.029916 May 26 19:48:55.145462 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 508/1006] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:55 2022] GET /compute/v2.1/servers/ac407afa-dd72-47a1-80df-6fdd04026cc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:48:55.238657 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1210121655", "imageRef": "e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b", "flavorRef": "452", "networks": [{"uuid": "12bedc7a-092f-46b2-9ceb-bac7f427ce8b"}]}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:55.289462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] validate_networks() for [('12bedc7a-092f-46b2-9ceb-bac7f427ce8b', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:48:55.624690 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:48:55.625113 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:48:55.625593 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:48:55.626000 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:48:55.626408 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:48:55.635169 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:55.635630 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:55.636425 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:55.636861 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:55.652975 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Getting quotas for project 826fe966558845f28e787f440f26b2a5. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:48:55.656895 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Getting quotas for user 0963bc628fbc453ab09dce6c5f3321bb and project 826fe966558845f28e787f440f26b2a5. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:48:55.668043 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:48:55.670236 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7b95d10-d2b2-4e9b-bd4a-99af9f3e3d6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:48:55.808773 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-340a8852-5bbb-4952-ae1c-126f10935c14 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573842 May 26 19:48:55.814251 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 499/1007] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:48:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:48:55.823515 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-6bd83217-1344-4bbf-8c97-984659fcca46 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:55.824376 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-6bd83217-1344-4bbf-8c97-984659fcca46 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:55.879266 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-6bd83217-1344-4bbf-8c97-984659fcca46 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:55.885343 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-6bd83217-1344-4bbf-8c97-984659fcca46 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1214 microversion: 2.1 time: 0.066294 May 26 19:48:55.893009 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 509/1008] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:55 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:56.902633 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-449cdbed-565a-432d-9084-7decfa1b04b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:56.903253 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-449cdbed-565a-432d-9084-7decfa1b04b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:56.910538 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-449cdbed-565a-432d-9084-7decfa1b04b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:56.911019 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-449cdbed-565a-432d-9084-7decfa1b04b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:56.911770 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-449cdbed-565a-432d-9084-7decfa1b04b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:56.912223 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-449cdbed-565a-432d-9084-7decfa1b04b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:56.976105 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-449cdbed-565a-432d-9084-7decfa1b04b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:56.983439 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-449cdbed-565a-432d-9084-7decfa1b04b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1218 microversion: 2.1 time: 0.085202 May 26 19:48:56.983995 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 500/1009] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:56 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:58.001237 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-83f781c8-27f6-4914-83d9-86aaaef7a311 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:58.002074 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-83f781c8-27f6-4914-83d9-86aaaef7a311 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:58.010247 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-83f781c8-27f6-4914-83d9-86aaaef7a311 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:58.010812 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-83f781c8-27f6-4914-83d9-86aaaef7a311 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:58.011685 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-83f781c8-27f6-4914-83d9-86aaaef7a311 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:58.012235 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-83f781c8-27f6-4914-83d9-86aaaef7a311 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:58.074984 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-83f781c8-27f6-4914-83d9-86aaaef7a311 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:58.083332 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-83f781c8-27f6-4914-83d9-86aaaef7a311 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1274 microversion: 2.1 time: 0.086035 May 26 19:48:58.084005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 510/1010] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:57 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:59.101481 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1dc97274-0963-4293-899a-0ba815f1d5e8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:48:59.102193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1dc97274-0963-4293-899a-0ba815f1d5e8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:48:59.108778 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1dc97274-0963-4293-899a-0ba815f1d5e8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:59.109231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1dc97274-0963-4293-899a-0ba815f1d5e8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:59.110002 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1dc97274-0963-4293-899a-0ba815f1d5e8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:59.110438 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1dc97274-0963-4293-899a-0ba815f1d5e8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:59.314504 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1dc97274-0963-4293-899a-0ba815f1d5e8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:48:59.323806 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1dc97274-0963-4293-899a-0ba815f1d5e8 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1314 microversion: 2.1 time: 0.227073 May 26 19:48:59.325442 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 501/1011] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:48:59 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:48:59.761517 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-73cedff8-3416-4133-ab93-dc88e9262153 req-8f4954cf-cdcc-49d0-b646-6e43ddab95da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad4ac194-e2ad-45cb-ad22-29268f769f36", "tag": "0c5a3726-e9c7-4402-adc2-74f282ad4a99"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:48:59.773314 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-73cedff8-3416-4133-ab93-dc88e9262153 req-8f4954cf-cdcc-49d0-b646-6e43ddab95da service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:48:59.773847 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-73cedff8-3416-4133-ab93-dc88e9262153 req-8f4954cf-cdcc-49d0-b646-6e43ddab95da service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:48:59.786282 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-73cedff8-3416-4133-ab93-dc88e9262153 req-8f4954cf-cdcc-49d0-b646-6e43ddab95da service nova] Creating event network-changed:0c5a3726-e9c7-4402-adc2-74f282ad4a99 for instance ad4ac194-e2ad-45cb-ad22-29268f769f36 on hv-cinder-82549 May 26 19:48:59.791106 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-73cedff8-3416-4133-ab93-dc88e9262153 req-8f4954cf-cdcc-49d0-b646-6e43ddab95da service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033483 May 26 19:48:59.791719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 511/1012] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:49:00.342181 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f641d8cf-3d20-4a79-b4c5-4328d10b784a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:00.342780 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f641d8cf-3d20-4a79-b4c5-4328d10b784a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:00.349944 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f641d8cf-3d20-4a79-b4c5-4328d10b784a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:00.350389 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f641d8cf-3d20-4a79-b4c5-4328d10b784a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:00.351174 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f641d8cf-3d20-4a79-b4c5-4328d10b784a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:00.351604 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f641d8cf-3d20-4a79-b4c5-4328d10b784a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:00.549779 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f641d8cf-3d20-4a79-b4c5-4328d10b784a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:00.557160 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f641d8cf-3d20-4a79-b4c5-4328d10b784a tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1314 microversion: 2.1 time: 0.218869 May 26 19:49:00.557869 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 502/1013] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:00 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:00.890570 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f3eb38a2-9cf8-416e-82ba-18b0d64872d6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:49:00.891555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f3eb38a2-9cf8-416e-82ba-18b0d64872d6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:00.898495 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f3eb38a2-9cf8-416e-82ba-18b0d64872d6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:00.898971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f3eb38a2-9cf8-416e-82ba-18b0d64872d6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:00.899736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f3eb38a2-9cf8-416e-82ba-18b0d64872d6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:00.900173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f3eb38a2-9cf8-416e-82ba-18b0d64872d6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:01.158017 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f3eb38a2-9cf8-416e-82ba-18b0d64872d6 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "POST /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/action" status: 202 len: 0 microversion: 2.1 time: 0.271980 May 26 19:49:01.159278 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 512/1014] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:49:00 2022] POST /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:49:01.166648 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-aec9b44b-ae66-4c85-82c5-9d98642f696b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:01.168286 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-aec9b44b-ae66-4c85-82c5-9d98642f696b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:01.173372 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-aec9b44b-ae66-4c85-82c5-9d98642f696b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:01.173825 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-aec9b44b-ae66-4c85-82c5-9d98642f696b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:01.175153 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-aec9b44b-ae66-4c85-82c5-9d98642f696b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:01.175601 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-aec9b44b-ae66-4c85-82c5-9d98642f696b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:01.316335 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-aec9b44b-ae66-4c85-82c5-9d98642f696b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:01.324459 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-aec9b44b-ae66-4c85-82c5-9d98642f696b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1752 microversion: 2.1 time: 0.161649 May 26 19:49:01.325028 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 503/1015] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:01 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:01.574294 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c89b0f4e-d0d3-4a6f-b5fa-c93d22669ca1 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:01.575153 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c89b0f4e-d0d3-4a6f-b5fa-c93d22669ca1 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:01.581309 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c89b0f4e-d0d3-4a6f-b5fa-c93d22669ca1 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:01.581755 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c89b0f4e-d0d3-4a6f-b5fa-c93d22669ca1 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:01.582518 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c89b0f4e-d0d3-4a6f-b5fa-c93d22669ca1 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:01.582981 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c89b0f4e-d0d3-4a6f-b5fa-c93d22669ca1 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:01.714285 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c89b0f4e-d0d3-4a6f-b5fa-c93d22669ca1 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:01.722252 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c89b0f4e-d0d3-4a6f-b5fa-c93d22669ca1 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1314 microversion: 2.1 time: 0.152314 May 26 19:49:01.722829 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 513/1016] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:01 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:02.341629 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-46d734d6-bb3c-487e-af6a-992f429b6153 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:02.342219 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-46d734d6-bb3c-487e-af6a-992f429b6153 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:02.349332 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46d734d6-bb3c-487e-af6a-992f429b6153 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:02.349870 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46d734d6-bb3c-487e-af6a-992f429b6153 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:02.350625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46d734d6-bb3c-487e-af6a-992f429b6153 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:02.351087 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-46d734d6-bb3c-487e-af6a-992f429b6153 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:02.495372 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-46d734d6-bb3c-487e-af6a-992f429b6153 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:02.503676 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-46d734d6-bb3c-487e-af6a-992f429b6153 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.166035 May 26 19:49:02.504244 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 504/1017] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:02 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:02.739431 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-428c79a2-073c-439e-982e-2e312b42e450 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:02.739972 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-428c79a2-073c-439e-982e-2e312b42e450 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:02.746699 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-428c79a2-073c-439e-982e-2e312b42e450 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:02.747173 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-428c79a2-073c-439e-982e-2e312b42e450 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:02.747926 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-428c79a2-073c-439e-982e-2e312b42e450 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:02.748391 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-428c79a2-073c-439e-982e-2e312b42e450 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:02.877036 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-428c79a2-073c-439e-982e-2e312b42e450 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:02.879379 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:02.885003 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-428c79a2-073c-439e-982e-2e312b42e450 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1314 microversion: 2.1 time: 0.149584 May 26 19:49:02.885562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 514/1018] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:02 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:03.521655 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f82e8942-c6cf-43e1-ac6a-c0dbc6e352f2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:03.522252 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f82e8942-c6cf-43e1-ac6a-c0dbc6e352f2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:03.528769 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f82e8942-c6cf-43e1-ac6a-c0dbc6e352f2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:03.533661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f82e8942-c6cf-43e1-ac6a-c0dbc6e352f2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:03.533661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f82e8942-c6cf-43e1-ac6a-c0dbc6e352f2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:03.533661 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f82e8942-c6cf-43e1-ac6a-c0dbc6e352f2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:03.534837 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:03.672173 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f82e8942-c6cf-43e1-ac6a-c0dbc6e352f2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:03.680199 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f82e8942-c6cf-43e1-ac6a-c0dbc6e352f2 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.162911 May 26 19:49:03.680780 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 505/1019] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:03 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:03.902494 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-04400194-d701-4de7-9d8d-627b6c6daefe tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:03.903071 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-04400194-d701-4de7-9d8d-627b6c6daefe tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:03.905609 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:03.910583 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04400194-d701-4de7-9d8d-627b6c6daefe tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:03.911056 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04400194-d701-4de7-9d8d-627b6c6daefe tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:03.917084 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04400194-d701-4de7-9d8d-627b6c6daefe tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:03.917084 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-04400194-d701-4de7-9d8d-627b6c6daefe tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:04.041538 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-04400194-d701-4de7-9d8d-627b6c6daefe tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:04.048736 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-04400194-d701-4de7-9d8d-627b6c6daefe tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1314 microversion: 2.1 time: 0.150235 May 26 19:49:04.049304 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 515/1020] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:03 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:04.698206 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c0108d43-f9de-4320-8152-cee74c2458af tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:04.698748 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c0108d43-f9de-4320-8152-cee74c2458af tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:04.705354 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c0108d43-f9de-4320-8152-cee74c2458af tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:04.705870 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c0108d43-f9de-4320-8152-cee74c2458af tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:04.706659 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c0108d43-f9de-4320-8152-cee74c2458af tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:04.707136 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c0108d43-f9de-4320-8152-cee74c2458af tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:04.851052 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c0108d43-f9de-4320-8152-cee74c2458af tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:04.859101 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c0108d43-f9de-4320-8152-cee74c2458af tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.165209 May 26 19:49:04.859677 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 506/1021] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:04 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:05.065861 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a475091f-6b20-4e85-b3fd-1f91ec62d804 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:05.066457 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a475091f-6b20-4e85-b3fd-1f91ec62d804 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:05.073313 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a475091f-6b20-4e85-b3fd-1f91ec62d804 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:05.073831 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a475091f-6b20-4e85-b3fd-1f91ec62d804 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:05.074534 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a475091f-6b20-4e85-b3fd-1f91ec62d804 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:05.074991 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a475091f-6b20-4e85-b3fd-1f91ec62d804 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:05.218056 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a475091f-6b20-4e85-b3fd-1f91ec62d804 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:05.226458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a475091f-6b20-4e85-b3fd-1f91ec62d804 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1314 microversion: 2.1 time: 0.165004 May 26 19:49:05.227045 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 516/1022] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:05 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:05.287991 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-4ae7894b-1f7b-4464-aa81-ed1aaa578c5e req-e281acb3-dc34-4645-b142-cef4e52511f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4ac194-e2ad-45cb-ad22-29268f769f36", "name": "network-vif-plugged", "status": "completed", "tag": "0c5a3726-e9c7-4402-adc2-74f282ad4a99"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:49:05.296063 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-4ae7894b-1f7b-4464-aa81-ed1aaa578c5e req-e281acb3-dc34-4645-b142-cef4e52511f1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:05.296505 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-4ae7894b-1f7b-4464-aa81-ed1aaa578c5e req-e281acb3-dc34-4645-b142-cef4e52511f1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:05.307503 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-4ae7894b-1f7b-4464-aa81-ed1aaa578c5e req-e281acb3-dc34-4645-b142-cef4e52511f1 service nova] Creating event network-vif-plugged:0c5a3726-e9c7-4402-adc2-74f282ad4a99 for instance ad4ac194-e2ad-45cb-ad22-29268f769f36 on hv-cinder-82549 May 26 19:49:05.312656 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-4ae7894b-1f7b-4464-aa81-ed1aaa578c5e req-e281acb3-dc34-4645-b142-cef4e52511f1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028869 May 26 19:49:05.313327 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 507/1023] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:49:05.877175 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-fe9cbd73-39ec-49ec-805b-eaf78489b25e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:05.877776 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-fe9cbd73-39ec-49ec-805b-eaf78489b25e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:05.882632 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:05.884470 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fe9cbd73-39ec-49ec-805b-eaf78489b25e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:05.884912 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fe9cbd73-39ec-49ec-805b-eaf78489b25e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:05.885694 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fe9cbd73-39ec-49ec-805b-eaf78489b25e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:05.886116 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-fe9cbd73-39ec-49ec-805b-eaf78489b25e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:06.027040 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-fe9cbd73-39ec-49ec-805b-eaf78489b25e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:06.034882 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-fe9cbd73-39ec-49ec-805b-eaf78489b25e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.161613 May 26 19:49:06.035527 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 517/1024] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:05 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:06.241366 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:06.242049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=6 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:06.246775 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-17795a30-5e18-4a37-93a8-a6c9da3b10bb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:06.247502 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-17795a30-5e18-4a37-93a8-a6c9da3b10bb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:06.253612 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-17795a30-5e18-4a37-93a8-a6c9da3b10bb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:06.254060 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-17795a30-5e18-4a37-93a8-a6c9da3b10bb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:06.254816 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-17795a30-5e18-4a37-93a8-a6c9da3b10bb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:06.255282 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-17795a30-5e18-4a37-93a8-a6c9da3b10bb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:06.384052 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-17795a30-5e18-4a37-93a8-a6c9da3b10bb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:06.391562 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-17795a30-5e18-4a37-93a8-a6c9da3b10bb tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1314 microversion: 2.1 time: 0.151225 May 26 19:49:06.392134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 508/1025] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:06 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:07.052080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-d76fdb5a-1a99-4e86-93a1-ed882849ba89 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:07.052692 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-d76fdb5a-1a99-4e86-93a1-ed882849ba89 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:07.059264 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d76fdb5a-1a99-4e86-93a1-ed882849ba89 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:07.059712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d76fdb5a-1a99-4e86-93a1-ed882849ba89 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:07.060477 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d76fdb5a-1a99-4e86-93a1-ed882849ba89 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:07.060912 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-d76fdb5a-1a99-4e86-93a1-ed882849ba89 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:07.205989 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-d76fdb5a-1a99-4e86-93a1-ed882849ba89 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:07.214301 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-d76fdb5a-1a99-4e86-93a1-ed882849ba89 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.166085 May 26 19:49:07.214878 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 518/1026] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:07 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:07.408323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-07dbd63a-fe44-485e-80fd-7f138c4efe13 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:07.409346 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-07dbd63a-fe44-485e-80fd-7f138c4efe13 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:07.415807 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07dbd63a-fe44-485e-80fd-7f138c4efe13 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:07.416254 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07dbd63a-fe44-485e-80fd-7f138c4efe13 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:07.417019 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07dbd63a-fe44-485e-80fd-7f138c4efe13 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:07.417646 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-07dbd63a-fe44-485e-80fd-7f138c4efe13 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:07.886884 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-07dbd63a-fe44-485e-80fd-7f138c4efe13 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:07.894770 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-07dbd63a-fe44-485e-80fd-7f138c4efe13 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1314 microversion: 2.1 time: 0.490436 May 26 19:49:07.898946 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 509/1027] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:07 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:08.230710 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-b87b9dd2-6d1c-44fe-ac58-8c64d675d7e1 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:08.231341 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-b87b9dd2-6d1c-44fe-ac58-8c64d675d7e1 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:08.237849 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b87b9dd2-6d1c-44fe-ac58-8c64d675d7e1 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:08.238295 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b87b9dd2-6d1c-44fe-ac58-8c64d675d7e1 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:08.239090 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b87b9dd2-6d1c-44fe-ac58-8c64d675d7e1 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:08.239528 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-b87b9dd2-6d1c-44fe-ac58-8c64d675d7e1 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:08.380545 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-b87b9dd2-6d1c-44fe-ac58-8c64d675d7e1 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:08.387456 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-b87b9dd2-6d1c-44fe-ac58-8c64d675d7e1 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.160649 May 26 19:49:08.388025 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 519/1028] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:08 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:08.911695 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bed71088-105e-4e2b-b68a-6e07e735685c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:08.912330 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bed71088-105e-4e2b-b68a-6e07e735685c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:08.914593 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:08.919704 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bed71088-105e-4e2b-b68a-6e07e735685c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:08.920192 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bed71088-105e-4e2b-b68a-6e07e735685c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:08.920963 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bed71088-105e-4e2b-b68a-6e07e735685c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:08.921402 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bed71088-105e-4e2b-b68a-6e07e735685c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:09.048883 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-bed71088-105e-4e2b-b68a-6e07e735685c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:09.056778 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bed71088-105e-4e2b-b68a-6e07e735685c tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1498 microversion: 2.1 time: 0.148927 May 26 19:49:09.057368 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 510/1029] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:08 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:09.404928 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-75fbb6fc-a68c-4b6b-b265-2c4eac3d09a5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:09.405542 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-75fbb6fc-a68c-4b6b-b265-2c4eac3d09a5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:09.412723 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75fbb6fc-a68c-4b6b-b265-2c4eac3d09a5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:09.413172 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75fbb6fc-a68c-4b6b-b265-2c4eac3d09a5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:09.413933 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75fbb6fc-a68c-4b6b-b265-2c4eac3d09a5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:09.414370 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-75fbb6fc-a68c-4b6b-b265-2c4eac3d09a5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:09.564347 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-75fbb6fc-a68c-4b6b-b265-2c4eac3d09a5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:09.572368 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-75fbb6fc-a68c-4b6b-b265-2c4eac3d09a5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.171547 May 26 19:49:09.572942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 520/1030] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:09 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:09.861611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ac3f535e-ee86-4cce-bbbb-b8df6bcf763e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:09.862187 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ac3f535e-ee86-4cce-bbbb-b8df6bcf763e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:09.868294 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ac3f535e-ee86-4cce-bbbb-b8df6bcf763e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:09.868751 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ac3f535e-ee86-4cce-bbbb-b8df6bcf763e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:09.869515 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ac3f535e-ee86-4cce-bbbb-b8df6bcf763e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:09.869976 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ac3f535e-ee86-4cce-bbbb-b8df6bcf763e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:09.897232 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ac3f535e-ee86-4cce-bbbb-b8df6bcf763e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:49:10.382847 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ac3f535e-ee86-4cce-bbbb-b8df6bcf763e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 204 len: 0 microversion: 2.1 time: 0.524825 May 26 19:49:10.383486 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 511/1031] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:49:09 2022] DELETE /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:49:10.400294 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-88c8a469-1f6a-459b-970f-dbb545edb266 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:10.400904 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-88c8a469-1f6a-459b-970f-dbb545edb266 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:10.406961 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-88c8a469-1f6a-459b-970f-dbb545edb266 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:10.407491 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-88c8a469-1f6a-459b-970f-dbb545edb266 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:10.408153 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-88c8a469-1f6a-459b-970f-dbb545edb266 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:10.408623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-88c8a469-1f6a-459b-970f-dbb545edb266 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:10.538080 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-88c8a469-1f6a-459b-970f-dbb545edb266 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:10.546073 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-88c8a469-1f6a-459b-970f-dbb545edb266 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1504 microversion: 2.1 time: 0.149641 May 26 19:49:10.546672 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 521/1032] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:10 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:10.590922 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1fe6d9c4-c0a4-4a6a-97a0-ff54b540d66f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:10.591652 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1fe6d9c4-c0a4-4a6a-97a0-ff54b540d66f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:10.598598 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9c4-c0a4-4a6a-97a0-ff54b540d66f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:10.608651 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9c4-c0a4-4a6a-97a0-ff54b540d66f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:10.608651 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9c4-c0a4-4a6a-97a0-ff54b540d66f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:10.608651 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9c4-c0a4-4a6a-97a0-ff54b540d66f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:10.741967 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-1fe6d9c4-c0a4-4a6a-97a0-ff54b540d66f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:10.750105 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1fe6d9c4-c0a4-4a6a-97a0-ff54b540d66f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.163466 May 26 19:49:10.750715 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 512/1033] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:10 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:11.563464 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-def65e05-e5ec-42a0-8e47-63bd6e405b88 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:11.564066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-def65e05-e5ec-42a0-8e47-63bd6e405b88 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:11.570643 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-def65e05-e5ec-42a0-8e47-63bd6e405b88 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:11.571127 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-def65e05-e5ec-42a0-8e47-63bd6e405b88 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:11.571887 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-def65e05-e5ec-42a0-8e47-63bd6e405b88 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:11.572317 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-def65e05-e5ec-42a0-8e47-63bd6e405b88 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:11.701802 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-def65e05-e5ec-42a0-8e47-63bd6e405b88 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:11.709747 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-def65e05-e5ec-42a0-8e47-63bd6e405b88 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1504 microversion: 2.1 time: 0.150126 May 26 19:49:11.710313 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 522/1034] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:11 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:11.767321 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c3dd08ae-2771-4904-8f3a-a81620d3bebf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:11.768463 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c3dd08ae-2771-4904-8f3a-a81620d3bebf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:11.774381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3dd08ae-2771-4904-8f3a-a81620d3bebf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:11.774827 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3dd08ae-2771-4904-8f3a-a81620d3bebf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:11.775618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3dd08ae-2771-4904-8f3a-a81620d3bebf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:11.776047 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c3dd08ae-2771-4904-8f3a-a81620d3bebf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:11.921398 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c3dd08ae-2771-4904-8f3a-a81620d3bebf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:11.929367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c3dd08ae-2771-4904-8f3a-a81620d3bebf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.166099 May 26 19:49:11.929942 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 513/1035] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:11 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:12.448199 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-cb547614-6d2d-44b7-a78a-2bfe1ace447c req-eb2702b1-851a-4d4f-8986-b7184af5bcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4ac194-e2ad-45cb-ad22-29268f769f36", "name": "network-vif-deleted", "tag": "0c5a3726-e9c7-4402-adc2-74f282ad4a99"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:49:12.456325 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-cb547614-6d2d-44b7-a78a-2bfe1ace447c req-eb2702b1-851a-4d4f-8986-b7184af5bcf1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:12.456766 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-cb547614-6d2d-44b7-a78a-2bfe1ace447c req-eb2702b1-851a-4d4f-8986-b7184af5bcf1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:12.467647 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-cb547614-6d2d-44b7-a78a-2bfe1ace447c req-eb2702b1-851a-4d4f-8986-b7184af5bcf1 service nova] Creating event network-vif-deleted:0c5a3726-e9c7-4402-adc2-74f282ad4a99 for instance ad4ac194-e2ad-45cb-ad22-29268f769f36 on hv-cinder-82549 May 26 19:49:12.472679 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-cb547614-6d2d-44b7-a78a-2bfe1ace447c req-eb2702b1-851a-4d4f-8986-b7184af5bcf1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028495 May 26 19:49:12.473451 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 523/1036] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:49:12.726819 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0b3ad2e4-c23c-4e37-b583-5727ff2fa16e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:12.727381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0b3ad2e4-c23c-4e37-b583-5727ff2fa16e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:12.733262 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0b3ad2e4-c23c-4e37-b583-5727ff2fa16e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:12.733709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0b3ad2e4-c23c-4e37-b583-5727ff2fa16e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:12.734455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0b3ad2e4-c23c-4e37-b583-5727ff2fa16e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:12.734886 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0b3ad2e4-c23c-4e37-b583-5727ff2fa16e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:12.797009 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0b3ad2e4-c23c-4e37-b583-5727ff2fa16e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0963bc628fbc453ab09dce6c5f3321bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fe966558845f28e787f440f26b2a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:12.805071 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0b3ad2e4-c23c-4e37-b583-5727ff2fa16e tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 200 len: 1299 microversion: 2.1 time: 0.082268 May 26 19:49:12.805621 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 514/1037] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:12 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:12.946247 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7fa28d67-adea-4151-a1bc-44c0491e03bd tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:12.946952 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7fa28d67-adea-4151-a1bc-44c0491e03bd tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:12.953629 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7fa28d67-adea-4151-a1bc-44c0491e03bd tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:12.954070 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7fa28d67-adea-4151-a1bc-44c0491e03bd tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:12.954817 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7fa28d67-adea-4151-a1bc-44c0491e03bd tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:12.955268 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-7fa28d67-adea-4151-a1bc-44c0491e03bd tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:13.099679 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7fa28d67-adea-4151-a1bc-44c0491e03bd tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:13.107857 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7fa28d67-adea-4151-a1bc-44c0491e03bd tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.165895 May 26 19:49:13.108432 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 524/1038] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:12 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:13.821649 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:13.822257 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] [instance: ad4ac194-e2ad-45cb-ad22-29268f769f36] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:13.828714 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:13.829162 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:13.829918 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:13.830386 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:13.843709 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] HTTP exception thrown: Instance ad4ac194-e2ad-45cb-ad22-29268f769f36 could not be found. May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Request method failure captured: May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 HTTP/1.1 May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9mS4icT4uAmfLIK39iGsgHYUxZmngViH5_djhzxW_rnH9lwW1Sx5Eqr7tMq8ix6GwXvgfozN8MlYJPZ-IHdqqrEipaYFdyKkr4qC7ycBPm1mA6m1C2dAmvg73CQEFOQpFrjXoDJuIzcwKSbZrPRG690cLcqpaNHhg5_IAIak0gWzVA May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: 826fe966558845f28e787f440f26b2a5 May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-VolumesActionsTest-98648486 May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:49:13.845323 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fe966558845f28e787f440f26b2a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fe966558845f28e787f440f26b2a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fe966558845f28e787f440f26b2a5", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fe966558845f28e787f440f26b2a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-VolumesActionsTest-98648486 May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: 826fe966558845f28e787f440f26b2a5 May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-VolumesActionsTest-98648486 May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-VolumesActionsTest-98648486-project May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 0963bc628fbc453ab09dce6c5f3321bb May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-VolumesActionsTest-98648486-project May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance ad4ac194-e2ad-45cb-ad22-29268f769f36 could not be found. May 26 19:49:13.847342 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': 'ad4ac194-e2ad-45cb-ad22-29268f769f36'} May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4ac194-e2ad-45cb-ad22-29268f769f36 could not be found. May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:49:13.848171 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4ac194-e2ad-45cb-ad22-29268f769f36 could not be found. May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4ac194-e2ad-45cb-ad22-29268f769f36 could not be found. May 26 19:49:13.849829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:49:13.851377 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] Returning 404 to user: Instance ad4ac194-e2ad-45cb-ad22-29268f769f36 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:49:13.851377 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-233a95bf-55ef-4a68-b138-5f7463e940b5 tempest-VolumesActionsTest-98648486 tempest-VolumesActionsTest-98648486-project] 10.222.0.72 "GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36" status: 404 len: 111 microversion: 2.1 time: 0.029509 May 26 19:49:13.851377 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 515/1039] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:13 2022] GET /compute/v2.1/servers/ad4ac194-e2ad-45cb-ad22-29268f769f36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:49:14.126251 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-58047f6f-42ba-4be6-b888-f647111585e7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:14.126871 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-58047f6f-42ba-4be6-b888-f647111585e7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:14.134015 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58047f6f-42ba-4be6-b888-f647111585e7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:14.134468 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58047f6f-42ba-4be6-b888-f647111585e7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:14.135268 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58047f6f-42ba-4be6-b888-f647111585e7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:14.135710 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58047f6f-42ba-4be6-b888-f647111585e7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:14.278334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-58047f6f-42ba-4be6-b888-f647111585e7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:14.286331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-58047f6f-42ba-4be6-b888-f647111585e7 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.164104 May 26 19:49:14.286918 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 525/1040] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:14 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:15.303205 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-7722c6d0-27aa-4ff3-af3e-ce96b7d9405b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:15.303853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-7722c6d0-27aa-4ff3-af3e-ce96b7d9405b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:15.310531 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7722c6d0-27aa-4ff3-af3e-ce96b7d9405b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:15.316410 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7722c6d0-27aa-4ff3-af3e-ce96b7d9405b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:15.316410 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7722c6d0-27aa-4ff3-af3e-ce96b7d9405b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:15.316410 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-7722c6d0-27aa-4ff3-af3e-ce96b7d9405b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:15.456765 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-7722c6d0-27aa-4ff3-af3e-ce96b7d9405b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:15.464722 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-7722c6d0-27aa-4ff3-af3e-ce96b7d9405b tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.166039 May 26 19:49:15.465281 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 516/1041] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:15 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:16.482234 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8aefb847-0a1a-4374-82b5-d112a7492e99 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:16.482869 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8aefb847-0a1a-4374-82b5-d112a7492e99 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:16.489885 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8aefb847-0a1a-4374-82b5-d112a7492e99 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:16.490330 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8aefb847-0a1a-4374-82b5-d112a7492e99 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:16.491125 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8aefb847-0a1a-4374-82b5-d112a7492e99 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:16.491571 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8aefb847-0a1a-4374-82b5-d112a7492e99 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:16.641600 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-8aefb847-0a1a-4374-82b5-d112a7492e99 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:16.651870 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8aefb847-0a1a-4374-82b5-d112a7492e99 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.173424 May 26 19:49:16.652446 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 526/1042] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:16 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:17.670332 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-e67ee8ec-0926-4907-a870-5f8c7ac028f5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:17.670866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-e67ee8ec-0926-4907-a870-5f8c7ac028f5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:17.678008 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e67ee8ec-0926-4907-a870-5f8c7ac028f5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:17.678462 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e67ee8ec-0926-4907-a870-5f8c7ac028f5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:17.679247 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e67ee8ec-0926-4907-a870-5f8c7ac028f5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:17.679686 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-e67ee8ec-0926-4907-a870-5f8c7ac028f5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:17.821225 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-e67ee8ec-0926-4907-a870-5f8c7ac028f5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:17.829233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-e67ee8ec-0926-4907-a870-5f8c7ac028f5 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.162956 May 26 19:49:17.829795 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 517/1043] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:17 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:18.845555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-a2ab6fb9-3bb7-4910-9496-e047458a42bf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:18.846164 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-a2ab6fb9-3bb7-4910-9496-e047458a42bf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:18.852771 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a2ab6fb9-3bb7-4910-9496-e047458a42bf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:18.853220 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a2ab6fb9-3bb7-4910-9496-e047458a42bf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:18.853975 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a2ab6fb9-3bb7-4910-9496-e047458a42bf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:18.854412 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-a2ab6fb9-3bb7-4910-9496-e047458a42bf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:18.992719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-a2ab6fb9-3bb7-4910-9496-e047458a42bf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:19.000930 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-a2ab6fb9-3bb7-4910-9496-e047458a42bf tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.159333 May 26 19:49:19.001501 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 527/1044] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:18 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:20.018189 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ecdf9d47-8b91-4eab-99b3-8f480582636e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:20.018807 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ecdf9d47-8b91-4eab-99b3-8f480582636e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:20.026052 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ecdf9d47-8b91-4eab-99b3-8f480582636e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:20.026513 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ecdf9d47-8b91-4eab-99b3-8f480582636e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:20.027310 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ecdf9d47-8b91-4eab-99b3-8f480582636e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:20.027963 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ecdf9d47-8b91-4eab-99b3-8f480582636e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:20.224884 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ecdf9d47-8b91-4eab-99b3-8f480582636e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:20.238444 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ecdf9d47-8b91-4eab-99b3-8f480582636e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.224146 May 26 19:49:20.239059 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 518/1045] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:20 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:21.256778 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-9fafe14a-8b28-4508-8340-ed9059f99954 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:21.258276 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-9fafe14a-8b28-4508-8340-ed9059f99954 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:21.265053 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9fafe14a-8b28-4508-8340-ed9059f99954 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:21.267168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9fafe14a-8b28-4508-8340-ed9059f99954 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:21.267168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9fafe14a-8b28-4508-8340-ed9059f99954 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:21.267168 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-9fafe14a-8b28-4508-8340-ed9059f99954 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:21.431635 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-9fafe14a-8b28-4508-8340-ed9059f99954 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:21.441798 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-9fafe14a-8b28-4508-8340-ed9059f99954 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.189506 May 26 19:49:21.443302 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 528/1046] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:21 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:22.460995 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ef84d3ac-83df-46cb-9a2f-2650e4a45ae0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:22.461603 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ef84d3ac-83df-46cb-9a2f-2650e4a45ae0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:22.467921 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef84d3ac-83df-46cb-9a2f-2650e4a45ae0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:22.468385 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef84d3ac-83df-46cb-9a2f-2650e4a45ae0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:22.469164 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef84d3ac-83df-46cb-9a2f-2650e4a45ae0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:22.469595 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ef84d3ac-83df-46cb-9a2f-2650e4a45ae0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:22.639399 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ef84d3ac-83df-46cb-9a2f-2650e4a45ae0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:22.648061 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ef84d3ac-83df-46cb-9a2f-2650e4a45ae0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.191451 May 26 19:49:22.648835 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 519/1047] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:22 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:23.666890 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0a864174-31cc-4e39-a928-fe752f300c60 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:23.667756 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0a864174-31cc-4e39-a928-fe752f300c60 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:23.678030 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0a864174-31cc-4e39-a928-fe752f300c60 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:23.678639 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0a864174-31cc-4e39-a928-fe752f300c60 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:23.679721 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0a864174-31cc-4e39-a928-fe752f300c60 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:23.680540 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0a864174-31cc-4e39-a928-fe752f300c60 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:23.858597 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0a864174-31cc-4e39-a928-fe752f300c60 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:23.867899 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0a864174-31cc-4e39-a928-fe752f300c60 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1757 microversion: 2.1 time: 0.206257 May 26 19:49:23.868480 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 529/1048] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:23 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:49:24.885771 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-325e40fe-22fd-4724-a5ee-0fc631edc1e9 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:49:24.886367 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-325e40fe-22fd-4724-a5ee-0fc631edc1e9 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:49:24.894604 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-325e40fe-22fd-4724-a5ee-0fc631edc1e9 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:24.895118 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-325e40fe-22fd-4724-a5ee-0fc631edc1e9 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:24.896097 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-325e40fe-22fd-4724-a5ee-0fc631edc1e9 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:49:24.896853 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-325e40fe-22fd-4724-a5ee-0fc631edc1e9 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:49:25.052137 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-325e40fe-22fd-4724-a5ee-0fc631edc1e9 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:49:25.060510 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-325e40fe-22fd-4724-a5ee-0fc631edc1e9 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1760 microversion: 2.1 time: 0.178775 May 26 19:49:25.061373 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 520/1049] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:49:24 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1760 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:50:03.866192 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-922be53b-8aad-4ad1-930c-daae2087ac5d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1243511219"}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:50:03.878405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-922be53b-8aad-4ad1-930c-daae2087ac5d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:03.878405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=29 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:03.878405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=87 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:03.878405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-922be53b-8aad-4ad1-930c-daae2087ac5d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:03.878405 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-922be53b-8aad-4ad1-930c-daae2087ac5d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:03.878939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-922be53b-8aad-4ad1-930c-daae2087ac5d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:03.878939 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-922be53b-8aad-4ad1-930c-daae2087ac5d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:04.000666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.network.security_group_api [None req-922be53b-8aad-4ad1-930c-daae2087ac5d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Removing security group f4987430-f9db-4539-b262-ce7b99282158 from port 1dd707d6-81e4-4739-aa53-6af3cd8a7202 May 26 19:50:04.467834 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-922be53b-8aad-4ad1-930c-daae2087ac5d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "POST /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/action" status: 202 len: 0 microversion: 2.1 time: 0.606133 May 26 19:50:04.468972 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 530/1050] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:50:03 2022] POST /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:50:04.484380 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-fa51f1a0-2039-4414-87d6-321874e94376 req-0606f599-ce9d-45cf-a6a6-d4ea8f83e5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06", "tag": "1dd707d6-81e4-4739-aa53-6af3cd8a7202"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:50:04.500175 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:04.501233 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:04.506876 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-fa51f1a0-2039-4414-87d6-321874e94376 req-0606f599-ce9d-45cf-a6a6-d4ea8f83e5b1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:04.507480 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-fa51f1a0-2039-4414-87d6-321874e94376 req-0606f599-ce9d-45cf-a6a6-d4ea8f83e5b1 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:04.524790 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-fa51f1a0-2039-4414-87d6-321874e94376 req-0606f599-ce9d-45cf-a6a6-d4ea8f83e5b1 service nova] Creating event network-changed:1dd707d6-81e4-4739-aa53-6af3cd8a7202 for instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 on hv-cinder-82549 May 26 19:50:04.530807 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-fa51f1a0-2039-4414-87d6-321874e94376 req-0606f599-ce9d-45cf-a6a6-d4ea8f83e5b1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050124 May 26 19:50:04.535096 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 521/1051] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:50:05.772301 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-22cca6c2-4158-4e4f-80b5-c7ae8b9eae66 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:05.772902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-22cca6c2-4158-4e4f-80b5-c7ae8b9eae66 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:05.779267 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22cca6c2-4158-4e4f-80b5-c7ae8b9eae66 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:05.779804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22cca6c2-4158-4e4f-80b5-c7ae8b9eae66 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:05.780636 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22cca6c2-4158-4e4f-80b5-c7ae8b9eae66 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:05.781161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-22cca6c2-4158-4e4f-80b5-c7ae8b9eae66 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:05.866773 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-22cca6c2-4158-4e4f-80b5-c7ae8b9eae66 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lazy-loading 'services' on Instance uuid 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:50:06.087545 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-22cca6c2-4158-4e4f-80b5-c7ae8b9eae66 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments/506d124e-0db9-401e-8a67-fe3a815b0d7b" status: 202 len: 0 microversion: 2.1 time: 0.319590 May 26 19:50:06.088136 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 531/1052] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:50:05 2022] DELETE /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments/506d124e-0db9-401e-8a67-fe3a815b0d7b => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:50:06.099928 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4bf3c160-de3a-4b38-8b8a-f40b0e7df20d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:06.101516 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4bf3c160-de3a-4b38-8b8a-f40b0e7df20d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:06.108860 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4bf3c160-de3a-4b38-8b8a-f40b0e7df20d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:06.109311 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4bf3c160-de3a-4b38-8b8a-f40b0e7df20d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:06.110457 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4bf3c160-de3a-4b38-8b8a-f40b0e7df20d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:06.110874 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4bf3c160-de3a-4b38-8b8a-f40b0e7df20d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:06.143000 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4bf3c160-de3a-4b38-8b8a-f40b0e7df20d tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050075 May 26 19:50:06.143587 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 522/1053] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:50:06 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:50:06.547971 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-9e1bf2dd-d4f9-4474-a433-9bd62c32eeda req-08b3894a-7903-486b-808f-120a28718bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06", "tag": "1dd707d6-81e4-4739-aa53-6af3cd8a7202"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:50:06.557091 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-9e1bf2dd-d4f9-4474-a433-9bd62c32eeda req-08b3894a-7903-486b-808f-120a28718bbd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:06.557532 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-9e1bf2dd-d4f9-4474-a433-9bd62c32eeda req-08b3894a-7903-486b-808f-120a28718bbd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:06.569254 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-9e1bf2dd-d4f9-4474-a433-9bd62c32eeda req-08b3894a-7903-486b-808f-120a28718bbd service nova] Creating event network-changed:1dd707d6-81e4-4739-aa53-6af3cd8a7202 for instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 on hv-cinder-82549 May 26 19:50:06.574402 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-9e1bf2dd-d4f9-4474-a433-9bd62c32eeda req-08b3894a-7903-486b-808f-120a28718bbd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030416 May 26 19:50:06.575047 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 532/1054] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:50:07.155947 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-81877cdb-ba0b-4f09-9464-3103c5291f16 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:07.157054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-81877cdb-ba0b-4f09-9464-3103c5291f16 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:07.165189 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81877cdb-ba0b-4f09-9464-3103c5291f16 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:07.165670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81877cdb-ba0b-4f09-9464-3103c5291f16 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:07.166470 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81877cdb-ba0b-4f09-9464-3103c5291f16 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:07.167061 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-81877cdb-ba0b-4f09-9464-3103c5291f16 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:07.199008 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-81877cdb-ba0b-4f09-9464-3103c5291f16 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047776 May 26 19:50:07.199568 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 523/1055] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:50:07 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:50:08.212460 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-605eec69-4029-45d1-ab16-65c074bee588 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:08.213461 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-605eec69-4029-45d1-ab16-65c074bee588 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:08.219759 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-605eec69-4029-45d1-ab16-65c074bee588 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:08.220212 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-605eec69-4029-45d1-ab16-65c074bee588 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:08.220973 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-605eec69-4029-45d1-ab16-65c074bee588 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:08.221406 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-605eec69-4029-45d1-ab16-65c074bee588 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:08.250712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-605eec69-4029-45d1-ab16-65c074bee588 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 May 26 19:50:08.252748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 533/1056] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:50:08 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:50:09.263490 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-b6b18aba-9436-4e1b-ba81-70a3ba7c41d0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:09.264349 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-b6b18aba-9436-4e1b-ba81-70a3ba7c41d0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:09.270801 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b6b18aba-9436-4e1b-ba81-70a3ba7c41d0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:09.273002 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b6b18aba-9436-4e1b-ba81-70a3ba7c41d0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:09.273002 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b6b18aba-9436-4e1b-ba81-70a3ba7c41d0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:09.273002 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-b6b18aba-9436-4e1b-ba81-70a3ba7c41d0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:09.300747 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-b6b18aba-9436-4e1b-ba81-70a3ba7c41d0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041773 May 26 19:50:09.301997 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 524/1057] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:50:09 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:50:10.313155 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e757b41c-4f7c-4f79-8322-a653babc6622 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:10.314075 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e757b41c-4f7c-4f79-8322-a653babc6622 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:10.321107 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e757b41c-4f7c-4f79-8322-a653babc6622 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:10.321549 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e757b41c-4f7c-4f79-8322-a653babc6622 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:10.322294 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e757b41c-4f7c-4f79-8322-a653babc6622 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:10.322724 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e757b41c-4f7c-4f79-8322-a653babc6622 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:10.350753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e757b41c-4f7c-4f79-8322-a653babc6622 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041633 May 26 19:50:10.351336 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 534/1058] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:50:10 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:50:11.362186 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2a26bca6-25d5-43e8-bb18-9c5681bcd5ef tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:11.363123 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2a26bca6-25d5-43e8-bb18-9c5681bcd5ef tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:11.370597 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a26bca6-25d5-43e8-bb18-9c5681bcd5ef tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:11.371091 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a26bca6-25d5-43e8-bb18-9c5681bcd5ef tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:11.372153 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a26bca6-25d5-43e8-bb18-9c5681bcd5ef tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:11.372593 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2a26bca6-25d5-43e8-bb18-9c5681bcd5ef tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:11.404716 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2a26bca6-25d5-43e8-bb18-9c5681bcd5ef tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046713 May 26 19:50:11.405275 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 525/1059] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:50:11 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:50:12.416659 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0b90c825-b9f2-4c66-9f1f-35abf08fb679 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:12.417636 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0b90c825-b9f2-4c66-9f1f-35abf08fb679 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:12.424127 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0b90c825-b9f2-4c66-9f1f-35abf08fb679 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:12.424576 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0b90c825-b9f2-4c66-9f1f-35abf08fb679 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:12.425342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0b90c825-b9f2-4c66-9f1f-35abf08fb679 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:12.425778 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0b90c825-b9f2-4c66-9f1f-35abf08fb679 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:12.455243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0b90c825-b9f2-4c66-9f1f-35abf08fb679 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042737 May 26 19:50:12.455815 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 535/1060] 10.222.0.72 () {58 vars in 1301 bytes} [Thu May 26 19:50:12 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 19:50:12.465522 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:12.466057 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:12.472631 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:12.473123 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:12.473903 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:12.474344 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:12.548823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] HTTP exception thrown: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 is not attached to volume 506d124e-0db9-401e-8a67-fe3a815b0d7b May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Request method failure captured: May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: DELETE /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments/506d124e-0db9-401e-8a67-fe3a815b0d7b HTTP/1.1 May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9ldYLEdkYQDoMWCIVSbCIsdHjD5ORLhW0h2mow7agUt9Gfbve-xK_eOyrbCEIUFsqUkD1oLz6cmxGkDaHWXRjQuXpqirDVQbFPLnq4PVLlzzy9Bw6T9am7vZksJWQM1jEmL537XHAT27t-LtUQcBlY3SiWPSZ7TruLkG_by3tEHZWk May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: f01283b247cc476682b191f71b1d03ed May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-TestMinimumBasicScenario-1140823363 May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:50:12.556927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f01283b247cc476682b191f71b1d03ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f01283b247cc476682b191f71b1d03ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f01283b247cc476682b191f71b1d03ed", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f01283b247cc476682b191f71b1d03ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-TestMinimumBasicScenario-1140823363 May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: f01283b247cc476682b191f71b1d03ed May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1140823363 May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-TestMinimumBasicScenario-1140823363-project May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: d4f1d06345f8419d84c746a509cab801 May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-TestMinimumBasicScenario-1140823363-project May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:50:12.558544 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 is not attached to volume 506d124e-0db9-401e-8a67-fe3a815b0d7b May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'server_id': '8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06', 'id': '506d124e-0db9-401e-8a67-fe3a815b0d7b'} May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 506d124e-0db9-401e-8a67-fe3a815b0d7b. May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:50:12.559383 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 is not attached to volume 506d124e-0db9-401e-8a67-fe3a815b0d7b May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 is not attached to volume 506d124e-0db9-401e-8a67-fe3a815b0d7b May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:50:12.560619 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Returning 404 to user: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 is not attached to volume 506d124e-0db9-401e-8a67-fe3a815b0d7b {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:50:12.561566 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c1fb4f3f-4ada-46db-8117-57ac3085f227 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments/506d124e-0db9-401e-8a67-fe3a815b0d7b" status: 404 len: 154 microversion: 2.1 time: 0.096880 May 26 19:50:12.561566 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 526/1061] 10.222.0.72 () {58 vars in 1415 bytes} [Thu May 26 19:50:12 2022] DELETE /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06/os-volume_attachments/506d124e-0db9-401e-8a67-fe3a815b0d7b => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:50:13.844767 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-8441cab0-c7c5-4840-b9cb-0ae84c785f67 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:13.845260 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8441cab0-c7c5-4840-b9cb-0ae84c785f67 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:13.851701 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8441cab0-c7c5-4840-b9cb-0ae84c785f67 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:13.852149 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8441cab0-c7c5-4840-b9cb-0ae84c785f67 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:13.852907 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8441cab0-c7c5-4840-b9cb-0ae84c785f67 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:13.853382 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-8441cab0-c7c5-4840-b9cb-0ae84c785f67 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:13.877707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-8441cab0-c7c5-4840-b9cb-0ae84c785f67 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Going to try to terminate instance {{(pid=124876) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:50:14.138949 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-8441cab0-c7c5-4840-b9cb-0ae84c785f67 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 204 len: 0 microversion: 2.1 time: 0.297639 May 26 19:50:14.139473 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 536/1062] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:50:13 2022] DELETE /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:50:14.147712 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-347fe8f9-c7c0-4c66-ba98-b67ff075b69f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:14.148366 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-347fe8f9-c7c0-4c66-ba98-b67ff075b69f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:14.155802 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-347fe8f9-c7c0-4c66-ba98-b67ff075b69f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:14.156255 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-347fe8f9-c7c0-4c66-ba98-b67ff075b69f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:14.157047 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-347fe8f9-c7c0-4c66-ba98-b67ff075b69f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:14.157488 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-347fe8f9-c7c0-4c66-ba98-b67ff075b69f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:14.297065 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-347fe8f9-c7c0-4c66-ba98-b67ff075b69f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:50:14.305300 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-347fe8f9-c7c0-4c66-ba98-b67ff075b69f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1555 microversion: 2.1 time: 0.161437 May 26 19:50:14.305857 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 527/1063] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:50:14 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:50:15.336632 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-25608ff0-2793-473f-a0ee-5a51d2bb4cb0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:15.337318 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-25608ff0-2793-473f-a0ee-5a51d2bb4cb0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:15.343753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-25608ff0-2793-473f-a0ee-5a51d2bb4cb0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:15.344197 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-25608ff0-2793-473f-a0ee-5a51d2bb4cb0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:15.344945 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-25608ff0-2793-473f-a0ee-5a51d2bb4cb0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:15.345400 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-25608ff0-2793-473f-a0ee-5a51d2bb4cb0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:15.472575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-25608ff0-2793-473f-a0ee-5a51d2bb4cb0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:50:15.480072 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-25608ff0-2793-473f-a0ee-5a51d2bb4cb0 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1555 microversion: 2.1 time: 0.148320 May 26 19:50:15.480637 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 537/1064] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:50:15 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:50:16.497828 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4c930db4-4cd8-44d8-8e7c-43a3a4fc9c0e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:16.498422 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4c930db4-4cd8-44d8-8e7c-43a3a4fc9c0e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:16.505289 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4c930db4-4cd8-44d8-8e7c-43a3a4fc9c0e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:16.505740 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4c930db4-4cd8-44d8-8e7c-43a3a4fc9c0e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:16.506504 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4c930db4-4cd8-44d8-8e7c-43a3a4fc9c0e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:16.506963 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4c930db4-4cd8-44d8-8e7c-43a3a4fc9c0e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:16.635166 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-4c930db4-4cd8-44d8-8e7c-43a3a4fc9c0e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:50:16.642736 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4c930db4-4cd8-44d8-8e7c-43a3a4fc9c0e tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1555 microversion: 2.1 time: 0.149052 May 26 19:50:16.643347 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 528/1065] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:50:16 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:50:16.738130 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-ca963565-ed00-49f5-bb91-07f3f0555856 req-61ad4584-eb75-43e2-933d-8839f37d0afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06", "name": "network-vif-deleted", "tag": "1dd707d6-81e4-4739-aa53-6af3cd8a7202"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:50:16.747606 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ca963565-ed00-49f5-bb91-07f3f0555856 req-61ad4584-eb75-43e2-933d-8839f37d0afd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:16.752906 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ca963565-ed00-49f5-bb91-07f3f0555856 req-61ad4584-eb75-43e2-933d-8839f37d0afd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:16.759753 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-ca963565-ed00-49f5-bb91-07f3f0555856 req-61ad4584-eb75-43e2-933d-8839f37d0afd service nova] Creating event network-vif-deleted:1dd707d6-81e4-4739-aa53-6af3cd8a7202 for instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 on hv-cinder-82549 May 26 19:50:16.764646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-ca963565-ed00-49f5-bb91-07f3f0555856 req-61ad4584-eb75-43e2-933d-8839f37d0afd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030228 May 26 19:50:16.765319 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 538/1066] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:50:17.660892 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:17.661498 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:17.670307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:17.670307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:17.670307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:17.670307 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:17.701133 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:17.701579 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:17.702019 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lazy-loading 'fault' on Instance uuid 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:50:17.744956 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f1d06345f8419d84c746a509cab801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f01283b247cc476682b191f71b1d03ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:50:17.752667 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-42e59525-8f73-49ca-a432-233bf3693f6f tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 200 len: 1349 microversion: 2.1 time: 0.095685 May 26 19:50:17.753263 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 529/1067] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:50:17 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:50:18.770847 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:18.771627 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] [instance: 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:50:18.778273 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:18.778725 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:18.779521 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:50:18.779962 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:50:18.793262 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.wsgi [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] HTTP exception thrown: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 could not be found. May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Request method failure captured: May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: request: GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 HTTP/1.1 May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept: application/json May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Accept-Encoding: identity May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Connection: close May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Length: 0 May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Content-Type: application/json May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Host: 10.222.0.72 May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Openstack-System-Scope: None May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: User-Agent: python-urllib3/1.26.9 May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Auth-Token: gAAAAABij9ldYLEdkYQDoMWCIVSbCIsdHjD5ORLhW0h2mow7agUt9Gfbve-xK_eOyrbCEIUFsqUkD1oLz6cmxGkDaHWXRjQuXpqirDVQbFPLnq4PVLlzzy9Bw6T9am7vZksJWQM1jEmL537XHAT27t-LtUQcBlY3SiWPSZ7TruLkG_by3tEHZWk May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Id: None May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Domain-Name: None May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Identity-Status: Confirmed May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Is-Admin-Project: True May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Id: default May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Domain-Name: Default May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Id: f01283b247cc476682b191f71b1d03ed May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Project-Name: tempest-TestMinimumBasicScenario-1140823363 May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Role: member,reader May 26 19:50:18.794805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Roles: member,reader May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f01283b247cc476682b191f71b1d03ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f01283b247cc476682b191f71b1d03ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f01283b247cc476682b191f71b1d03ed", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f01283b247cc476682b191f71b1d03ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant: tempest-TestMinimumBasicScenario-1140823363 May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Id: f01283b247cc476682b191f71b1d03ed May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1140823363 May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User: tempest-TestMinimumBasicScenario-1140823363-project May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Id: default May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Domain-Name: Default May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Id: d4f1d06345f8419d84c746a509cab801 May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: X-User-Name: tempest-TestMinimumBasicScenario-1140823363-project May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: method: > May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: exception: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 could not be found. May 26 19:50:18.799942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: action_args: {'id': '8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06'} May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 could not be found. May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:50:18.800844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 could not be found. May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 could not be found. May 26 19:50:18.802369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: ERROR nova.api.openstack.wsgi May 26 19:50:18.803748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Returning 404 to user: Instance 8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 could not be found. {{(pid=124876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:50:18.803748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2838be66-5f5e-4d35-a78f-11f9d63374ed tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06" status: 404 len: 111 microversion: 2.1 time: 0.030334 May 26 19:50:18.803748 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 539/1068] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:50:18 2022] GET /compute/v2.1/servers/8fc8d22b-5f81-4ef5-aca5-7ff6dc6e1e06 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:50:18.805001 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2b58e7bf-be8f-4a8d-a060-c10d218d9a69 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] Calling method '.version_select at 0x7fa788437ca0>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:50:18.877217 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2b58e7bf-be8f-4a8d-a060-c10d218d9a69 tempest-TestMinimumBasicScenario-1140823363 tempest-TestMinimumBasicScenario-1140823363-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1062238906" status: 202 len: 0 microversion: 2.1 time: 0.076072 May 26 19:50:18.877833 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 530/1069] 10.222.0.72 () {58 vars in 1271 bytes} [Thu May 26 19:50:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1062238906 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:50:22.617800 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:50:22.618389 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Thu May 26 19:50:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 19:50:41.606372 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:41.607144 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:41.801623 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3e5c410d-13e7-484d-972b-4686fb2ad38c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Action: 'create', calling method: .version_select at 0x7fa788120670>, body: {"keypair": {"name": "tempest-TestShelveInstance-871265355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbe0Z7SL1QMraQiboulXyO9yl+0Sr/AXiknf2MqEgIgyelUjgdq08fHLWUNVYvK+MHaCcoFcAAEXlR9O1ukLNzWzwPmVyIdqaxdoQai9Q1r5Gx3jwLt2bSCwmFIRi+WpA=="}} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:50:41.816849 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-3e5c410d-13e7-484d-972b-4686fb2ad38c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Getting quotas for project b321ef1c40e0427fb5ea28acac45322b. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:50:41.820662 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.quota [None req-3e5c410d-13e7-484d-972b-4686fb2ad38c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Getting quotas for user 31ae36aaeb224d0984a4ff88f15545db and project b321ef1c40e0427fb5ea28acac45322b. Resources: {'key_pairs'} {{(pid=124876) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:50:41.907575 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3e5c410d-13e7-484d-972b-4686fb2ad38c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.305911 May 26 19:50:41.908696 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 540/1070] 10.222.0.72 () {60 vars in 1158 bytes} [Thu May 26 19:50:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:51:01.238056 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1855159854", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-871265355", "security_groups": [{"name": "tempest-secgroup-smoke-1016632194"}], "networks": [{"uuid": "b3bc02ff-85cd-4b54-9247-099ac7b7141b"}], "block_device_mapping_v2": [{"uuid": "5c3cfc5e-bac9-45eb-8ce7-cbe4e2776568", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:51:01.247889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=52 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:51:01.248522 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:51:01.350123 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.network.neutron [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] validate_networks() for [('b3bc02ff-85cd-4b54-9247-099ac7b7141b', None, None, None, None, None)] {{(pid=124877) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 19:51:01.712248 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Flavor limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 19:51:01.712664 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Image limits 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 19:51:01.713625 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Flavor pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 19:51:01.714054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Image pref 0:0:0 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 19:51:01.714457 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.virt.hardware [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 19:51:01.723104 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:01.723548 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:01.724341 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:01.724769 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:01.741266 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Getting quotas for project b321ef1c40e0427fb5ea28acac45322b. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 19:51:01.745216 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.quota [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Getting quotas for user 31ae36aaeb224d0984a4ff88f15545db and project b321ef1c40e0427fb5ea28acac45322b. Resources: {'cores', 'instances', 'ram'} {{(pid=124877) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 19:51:01.801144 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Going to run 1 instances... {{(pid=124877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 19:51:01.803308 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c3cfc5e-bac9-45eb-8ce7-cbe4e2776568',volume_size=None,volume_type=None)] {{(pid=124877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 19:51:02.168707 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-63558c11-8121-46c6-9e3e-160c7299318e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.934547 May 26 19:51:02.169341 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 531/1071] 10.222.0.72 () {60 vars in 1146 bytes} [Thu May 26 19:51:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 19:51:02.177453 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=4 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:51:02.178462 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:51:02.183043 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-7df1b368-180e-4070-83d5-03c4e7fc955d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:02.190150 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-7df1b368-180e-4070-83d5-03c4e7fc955d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:02.235668 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-7df1b368-180e-4070-83d5-03c4e7fc955d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:02.242473 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-7df1b368-180e-4070-83d5-03c4e7fc955d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1088 microversion: 2.1 time: 0.066295 May 26 19:51:02.243070 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 541/1072] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:02 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:03.260634 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-615bbd6e-a5b7-489f-9635-a6fd5ec6be80 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:03.261223 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-615bbd6e-a5b7-489f-9635-a6fd5ec6be80 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:03.268039 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-615bbd6e-a5b7-489f-9635-a6fd5ec6be80 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:03.268487 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-615bbd6e-a5b7-489f-9635-a6fd5ec6be80 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:03.269249 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-615bbd6e-a5b7-489f-9635-a6fd5ec6be80 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:03.269683 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-615bbd6e-a5b7-489f-9635-a6fd5ec6be80 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:03.331329 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-615bbd6e-a5b7-489f-9635-a6fd5ec6be80 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:03.339877 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-615bbd6e-a5b7-489f-9635-a6fd5ec6be80 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1138 microversion: 2.1 time: 0.083521 May 26 19:51:03.340461 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 532/1073] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:03 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:04.357580 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-24872f5f-cdad-46e5-a82c-671b84ac911e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:04.358243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-24872f5f-cdad-46e5-a82c-671b84ac911e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:04.367718 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-24872f5f-cdad-46e5-a82c-671b84ac911e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:04.368459 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-24872f5f-cdad-46e5-a82c-671b84ac911e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:04.369892 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-24872f5f-cdad-46e5-a82c-671b84ac911e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:04.370331 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-24872f5f-cdad-46e5-a82c-671b84ac911e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:04.432820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-24872f5f-cdad-46e5-a82c-671b84ac911e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:04.440436 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-24872f5f-cdad-46e5-a82c-671b84ac911e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1194 microversion: 2.1 time: 0.087804 May 26 19:51:04.443290 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 542/1074] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:04 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:05.456935 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5f827b69-ef2e-4a83-b738-16aee93a6f25 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:05.457552 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5f827b69-ef2e-4a83-b738-16aee93a6f25 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:05.464062 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f827b69-ef2e-4a83-b738-16aee93a6f25 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:05.464517 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f827b69-ef2e-4a83-b738-16aee93a6f25 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:05.465280 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f827b69-ef2e-4a83-b738-16aee93a6f25 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:05.465717 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5f827b69-ef2e-4a83-b738-16aee93a6f25 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:05.644682 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5f827b69-ef2e-4a83-b738-16aee93a6f25 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:05.653207 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5f827b69-ef2e-4a83-b738-16aee93a6f25 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1272 microversion: 2.1 time: 0.200156 May 26 19:51:05.653782 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 533/1075] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:05 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:06.104453 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-ca14e380-c472-484e-bc11-3cba892fd06d req-297deae5-8c18-43a1-af7d-bc41383fab44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d513a87-789f-41b6-91b0-b5a3624aae22", "tag": "a225d11b-f3f0-40f4-a4be-e42546652b57"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:51:06.113985 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ca14e380-c472-484e-bc11-3cba892fd06d req-297deae5-8c18-43a1-af7d-bc41383fab44 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:06.114719 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-ca14e380-c472-484e-bc11-3cba892fd06d req-297deae5-8c18-43a1-af7d-bc41383fab44 service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:06.127969 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-ca14e380-c472-484e-bc11-3cba892fd06d req-297deae5-8c18-43a1-af7d-bc41383fab44 service nova] Creating event network-changed:a225d11b-f3f0-40f4-a4be-e42546652b57 for instance 0d513a87-789f-41b6-91b0-b5a3624aae22 on hv-cinder-82549 May 26 19:51:06.133217 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-ca14e380-c472-484e-bc11-3cba892fd06d req-297deae5-8c18-43a1-af7d-bc41383fab44 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032997 May 26 19:51:06.140831 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 543/1076] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:51:06.671611 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-f88990db-4e66-4963-9c0e-1a5b9f9ee8cd tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:06.672228 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-f88990db-4e66-4963-9c0e-1a5b9f9ee8cd tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:06.678745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f88990db-4e66-4963-9c0e-1a5b9f9ee8cd tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:06.679237 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f88990db-4e66-4963-9c0e-1a5b9f9ee8cd tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:06.680012 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f88990db-4e66-4963-9c0e-1a5b9f9ee8cd tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:06.680455 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-f88990db-4e66-4963-9c0e-1a5b9f9ee8cd tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:06.879805 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-f88990db-4e66-4963-9c0e-1a5b9f9ee8cd tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:06.887787 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-f88990db-4e66-4963-9c0e-1a5b9f9ee8cd tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.220129 May 26 19:51:06.891145 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 534/1077] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:06 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:07.906390 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-53cc02b8-f219-496c-8cdf-f94f07cf8977 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:07.907113 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-53cc02b8-f219-496c-8cdf-f94f07cf8977 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:07.913267 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-53cc02b8-f219-496c-8cdf-f94f07cf8977 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:07.913714 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-53cc02b8-f219-496c-8cdf-f94f07cf8977 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:07.914469 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-53cc02b8-f219-496c-8cdf-f94f07cf8977 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:07.914922 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-53cc02b8-f219-496c-8cdf-f94f07cf8977 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:08.045955 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-53cc02b8-f219-496c-8cdf-f94f07cf8977 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:08.053283 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-53cc02b8-f219-496c-8cdf-f94f07cf8977 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.151640 May 26 19:51:08.053844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 544/1078] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:07 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:09.073528 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-eba17092-d8b2-4538-b777-ad3be6afb9dc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:09.074139 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-eba17092-d8b2-4538-b777-ad3be6afb9dc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:09.080636 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eba17092-d8b2-4538-b777-ad3be6afb9dc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:09.081080 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eba17092-d8b2-4538-b777-ad3be6afb9dc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:09.081823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eba17092-d8b2-4538-b777-ad3be6afb9dc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:09.082253 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-eba17092-d8b2-4538-b777-ad3be6afb9dc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:09.209331 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-eba17092-d8b2-4538-b777-ad3be6afb9dc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:09.217197 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-eba17092-d8b2-4538-b777-ad3be6afb9dc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.147511 May 26 19:51:09.217762 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 535/1079] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:09 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:10.233586 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f6966fce-32f5-4dda-b923-bc27b0c51953 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:10.234200 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f6966fce-32f5-4dda-b923-bc27b0c51953 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:10.241384 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f6966fce-32f5-4dda-b923-bc27b0c51953 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:10.241906 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f6966fce-32f5-4dda-b923-bc27b0c51953 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:10.242673 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f6966fce-32f5-4dda-b923-bc27b0c51953 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:10.243151 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f6966fce-32f5-4dda-b923-bc27b0c51953 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:10.373061 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f6966fce-32f5-4dda-b923-bc27b0c51953 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:10.379525 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f6966fce-32f5-4dda-b923-bc27b0c51953 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.149857 May 26 19:51:10.380086 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 545/1080] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:10 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:11.396644 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-5a9f343f-8734-432a-8872-deaeedd807c8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:11.399016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-5a9f343f-8734-432a-8872-deaeedd807c8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:11.403337 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5a9f343f-8734-432a-8872-deaeedd807c8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:11.403785 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5a9f343f-8734-432a-8872-deaeedd807c8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:11.404536 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5a9f343f-8734-432a-8872-deaeedd807c8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:11.404969 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-5a9f343f-8734-432a-8872-deaeedd807c8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:11.534848 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-5a9f343f-8734-432a-8872-deaeedd807c8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:11.542794 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-5a9f343f-8734-432a-8872-deaeedd807c8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.150211 May 26 19:51:11.543458 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 536/1081] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:11 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:12.560178 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e9541c96-8d05-4e4f-a7c8-eecfed3055a8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:12.560714 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e9541c96-8d05-4e4f-a7c8-eecfed3055a8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:12.563152 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell0:SELECT=2 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:51:12.567937 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e9541c96-8d05-4e4f-a7c8-eecfed3055a8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:12.568378 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e9541c96-8d05-4e4f-a7c8-eecfed3055a8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:12.569127 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e9541c96-8d05-4e4f-a7c8-eecfed3055a8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:12.569551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e9541c96-8d05-4e4f-a7c8-eecfed3055a8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:12.698355 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e9541c96-8d05-4e4f-a7c8-eecfed3055a8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:12.705724 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e9541c96-8d05-4e4f-a7c8-eecfed3055a8 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.150044 May 26 19:51:12.706288 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 546/1082] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:12 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:13.722995 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-496719ad-4fb7-4920-8b3f-35f9ed5f9c93 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:13.723600 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-496719ad-4fb7-4920-8b3f-35f9ed5f9c93 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:13.725436 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:51:13.726083 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell0:SELECT=6 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:51:13.731982 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-496719ad-4fb7-4920-8b3f-35f9ed5f9c93 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:13.732429 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-496719ad-4fb7-4920-8b3f-35f9ed5f9c93 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:13.733182 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-496719ad-4fb7-4920-8b3f-35f9ed5f9c93 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:13.733608 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-496719ad-4fb7-4920-8b3f-35f9ed5f9c93 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:13.863702 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-496719ad-4fb7-4920-8b3f-35f9ed5f9c93 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:13.871271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-496719ad-4fb7-4920-8b3f-35f9ed5f9c93 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.152103 May 26 19:51:13.871836 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 537/1083] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:13 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:14.890108 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-830279c7-2a9e-4f4f-b54a-b7fe74fa8304 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:14.890712 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-830279c7-2a9e-4f4f-b54a-b7fe74fa8304 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:14.897203 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-830279c7-2a9e-4f4f-b54a-b7fe74fa8304 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:14.897646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-830279c7-2a9e-4f4f-b54a-b7fe74fa8304 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:14.898392 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-830279c7-2a9e-4f4f-b54a-b7fe74fa8304 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:14.898820 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-830279c7-2a9e-4f4f-b54a-b7fe74fa8304 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:15.025928 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-830279c7-2a9e-4f4f-b54a-b7fe74fa8304 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:15.033396 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-830279c7-2a9e-4f4f-b54a-b7fe74fa8304 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.147227 May 26 19:51:15.034007 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 547/1084] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:14 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:15.844597 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-d136c6af-e5c0-422e-a3d2-5a3f17e62980 req-0e14621b-f3a7-401c-9235-523a1670a2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d513a87-789f-41b6-91b0-b5a3624aae22", "name": "network-vif-plugged", "status": "completed", "tag": "a225d11b-f3f0-40f4-a4be-e42546652b57"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:51:15.853539 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-d136c6af-e5c0-422e-a3d2-5a3f17e62980 req-0e14621b-f3a7-401c-9235-523a1670a2cf service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:15.854641 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-d136c6af-e5c0-422e-a3d2-5a3f17e62980 req-0e14621b-f3a7-401c-9235-523a1670a2cf service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:15.864720 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-d136c6af-e5c0-422e-a3d2-5a3f17e62980 req-0e14621b-f3a7-401c-9235-523a1670a2cf service nova] Creating event network-vif-plugged:a225d11b-f3f0-40f4-a4be-e42546652b57 for instance 0d513a87-789f-41b6-91b0-b5a3624aae22 on hv-cinder-82549 May 26 19:51:15.869829 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-d136c6af-e5c0-422e-a3d2-5a3f17e62980 req-0e14621b-f3a7-401c-9235-523a1670a2cf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029192 May 26 19:51:15.872350 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 538/1085] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:51:16.049558 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-babee2da-a859-4c45-b7b3-ab483332721d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:16.050246 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-babee2da-a859-4c45-b7b3-ab483332721d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:16.057347 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-babee2da-a859-4c45-b7b3-ab483332721d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:16.057786 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-babee2da-a859-4c45-b7b3-ab483332721d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:16.058530 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-babee2da-a859-4c45-b7b3-ab483332721d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:16.058979 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-babee2da-a859-4c45-b7b3-ab483332721d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:16.203942 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-babee2da-a859-4c45-b7b3-ab483332721d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:16.211435 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-babee2da-a859-4c45-b7b3-ab483332721d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.165896 May 26 19:51:16.212007 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 548/1086] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:16 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:17.228570 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-c4c27982-70ff-405b-a83b-7069cc7689f1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:17.229270 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-c4c27982-70ff-405b-a83b-7069cc7689f1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:17.235998 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c4c27982-70ff-405b-a83b-7069cc7689f1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:17.236446 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c4c27982-70ff-405b-a83b-7069cc7689f1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:17.237204 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c4c27982-70ff-405b-a83b-7069cc7689f1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:17.237644 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-c4c27982-70ff-405b-a83b-7069cc7689f1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:17.375394 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-c4c27982-70ff-405b-a83b-7069cc7689f1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:17.382733 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-c4c27982-70ff-405b-a83b-7069cc7689f1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1260 microversion: 2.1 time: 0.158397 May 26 19:51:17.383317 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 539/1087] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:17 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:18.399759 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1c1142b8-a1e9-4fc8-9b7e-638cbe91068d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:18.400891 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1c1142b8-a1e9-4fc8-9b7e-638cbe91068d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:18.407369 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1c1142b8-a1e9-4fc8-9b7e-638cbe91068d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:18.407840 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1c1142b8-a1e9-4fc8-9b7e-638cbe91068d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:18.408598 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1c1142b8-a1e9-4fc8-9b7e-638cbe91068d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:18.409029 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1c1142b8-a1e9-4fc8-9b7e-638cbe91068d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:18.537622 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1c1142b8-a1e9-4fc8-9b7e-638cbe91068d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:18.545644 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1c1142b8-a1e9-4fc8-9b7e-638cbe91068d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1444 microversion: 2.1 time: 0.149735 May 26 19:51:18.546210 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 549/1088] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:18 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:18.561410 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-d74ffcad-2cbd-4603-ba65-7b88f9d87e6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:51:18.562016 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-d74ffcad-2cbd-4603-ba65-7b88f9d87e6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:51:18.568433 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d74ffcad-2cbd-4603-ba65-7b88f9d87e6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:18.568884 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d74ffcad-2cbd-4603-ba65-7b88f9d87e6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:18.569642 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d74ffcad-2cbd-4603-ba65-7b88f9d87e6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:18.570076 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-d74ffcad-2cbd-4603-ba65-7b88f9d87e6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:18.695717 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-d74ffcad-2cbd-4603-ba65-7b88f9d87e6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:51:18.703710 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-d74ffcad-2cbd-4603-ba65-7b88f9d87e6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1444 microversion: 2.1 time: 0.146169 May 26 19:51:18.704271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 540/1089] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:51:18 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:51:20.929036 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-6ef31145-468f-422a-ac33-5d7421de91a1 req-a9a3f2d2-42df-438d-b9a8-ae083771a85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d513a87-789f-41b6-91b0-b5a3624aae22", "tag": "a225d11b-f3f0-40f4-a4be-e42546652b57"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:51:20.937587 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-6ef31145-468f-422a-ac33-5d7421de91a1 req-a9a3f2d2-42df-438d-b9a8-ae083771a85e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:51:20.938036 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-6ef31145-468f-422a-ac33-5d7421de91a1 req-a9a3f2d2-42df-438d-b9a8-ae083771a85e service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:51:20.950307 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-6ef31145-468f-422a-ac33-5d7421de91a1 req-a9a3f2d2-42df-438d-b9a8-ae083771a85e service nova] Creating event network-changed:a225d11b-f3f0-40f4-a4be-e42546652b57 for instance 0d513a87-789f-41b6-91b0-b5a3624aae22 on hv-cinder-82549 May 26 19:51:20.955377 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-6ef31145-468f-422a-ac33-5d7421de91a1 req-a9a3f2d2-42df-438d-b9a8-ae083771a85e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030037 May 26 19:51:20.956123 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 550/1090] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:53:17.271271 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:17.272025 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=52 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:17.276068 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-1521bc42-ea4c-4b28-93bc-024118e112ab tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:53:17.276605 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-1521bc42-ea4c-4b28-93bc-024118e112ab tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:17.282995 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1521bc42-ea4c-4b28-93bc-024118e112ab tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:17.285358 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1521bc42-ea4c-4b28-93bc-024118e112ab tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:17.285358 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1521bc42-ea4c-4b28-93bc-024118e112ab tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:17.285358 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-1521bc42-ea4c-4b28-93bc-024118e112ab tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:17.307926 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.objects.instance [None req-1521bc42-ea4c-4b28-93bc-024118e112ab tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lazy-loading 'flavor' on Instance uuid 0d513a87-789f-41b6-91b0-b5a3624aae22 {{(pid=124877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:53:17.506079 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-1521bc42-ea4c-4b28-93bc-024118e112ab tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "POST /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22/action" status: 202 len: 0 microversion: 2.1 time: 0.236483 May 26 19:53:17.509109 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 541/1091] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:53:17 2022] POST /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:53:17.513551 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=22 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:17.514303 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=46 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:17.518532 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3b9326ad-49f6-4f22-a18b-6b674316f50b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:17.519262 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3b9326ad-49f6-4f22-a18b-6b674316f50b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:17.525243 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b9326ad-49f6-4f22-a18b-6b674316f50b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:17.525690 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b9326ad-49f6-4f22-a18b-6b674316f50b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:17.526449 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b9326ad-49f6-4f22-a18b-6b674316f50b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:17.526883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3b9326ad-49f6-4f22-a18b-6b674316f50b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:17.709021 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3b9326ad-49f6-4f22-a18b-6b674316f50b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:17.717131 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3b9326ad-49f6-4f22-a18b-6b674316f50b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.205619 May 26 19:53:17.717696 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 551/1092] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:17 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:18.736074 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-988fc065-dad7-4b07-857f-a6d8d55e6d2f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:18.736687 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-988fc065-dad7-4b07-857f-a6d8d55e6d2f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:18.742889 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-988fc065-dad7-4b07-857f-a6d8d55e6d2f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:18.743379 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-988fc065-dad7-4b07-857f-a6d8d55e6d2f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:18.744138 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-988fc065-dad7-4b07-857f-a6d8d55e6d2f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:18.744575 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-988fc065-dad7-4b07-857f-a6d8d55e6d2f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:18.926994 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-988fc065-dad7-4b07-857f-a6d8d55e6d2f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:18.935021 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-988fc065-dad7-4b07-857f-a6d8d55e6d2f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.204371 May 26 19:53:18.935587 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 542/1093] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:18 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:19.952676 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-3ebeca32-2c89-42e7-adf3-d154a61a81af tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:19.953265 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-3ebeca32-2c89-42e7-adf3-d154a61a81af tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:19.959995 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3ebeca32-2c89-42e7-adf3-d154a61a81af tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:19.960435 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3ebeca32-2c89-42e7-adf3-d154a61a81af tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:19.961185 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3ebeca32-2c89-42e7-adf3-d154a61a81af tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:19.961613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-3ebeca32-2c89-42e7-adf3-d154a61a81af tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:20.088320 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-3ebeca32-2c89-42e7-adf3-d154a61a81af tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:20.095858 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-3ebeca32-2c89-42e7-adf3-d154a61a81af tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.147110 May 26 19:53:20.096416 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 552/1094] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:19 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:21.112697 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-2e87937c-da81-44c2-8cd2-3bbe8edb1fd7 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:21.113296 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-2e87937c-da81-44c2-8cd2-3bbe8edb1fd7 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:21.119733 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2e87937c-da81-44c2-8cd2-3bbe8edb1fd7 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:21.120177 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2e87937c-da81-44c2-8cd2-3bbe8edb1fd7 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:21.120924 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2e87937c-da81-44c2-8cd2-3bbe8edb1fd7 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:21.121381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-2e87937c-da81-44c2-8cd2-3bbe8edb1fd7 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:21.252208 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-2e87937c-da81-44c2-8cd2-3bbe8edb1fd7 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:21.259632 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-2e87937c-da81-44c2-8cd2-3bbe8edb1fd7 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.150835 May 26 19:53:21.260188 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 543/1095] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:21 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:22.276476 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e488446e-c15b-4add-929b-f1a1f2148f95 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:22.277084 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e488446e-c15b-4add-929b-f1a1f2148f95 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:22.283559 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e488446e-c15b-4add-929b-f1a1f2148f95 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:22.284000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e488446e-c15b-4add-929b-f1a1f2148f95 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:22.284752 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e488446e-c15b-4add-929b-f1a1f2148f95 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:22.285182 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e488446e-c15b-4add-929b-f1a1f2148f95 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:22.412000 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e488446e-c15b-4add-929b-f1a1f2148f95 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:22.420222 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e488446e-c15b-4add-929b-f1a1f2148f95 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.147536 May 26 19:53:22.421593 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 553/1096] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:22 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:23.436755 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-3b5b6918-d260-4c20-858c-44f9ff4b8585 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:23.437361 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-3b5b6918-d260-4c20-858c-44f9ff4b8585 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:23.443927 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3b5b6918-d260-4c20-858c-44f9ff4b8585 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:23.444372 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3b5b6918-d260-4c20-858c-44f9ff4b8585 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:23.445127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3b5b6918-d260-4c20-858c-44f9ff4b8585 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:23.445558 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-3b5b6918-d260-4c20-858c-44f9ff4b8585 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:23.576976 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-3b5b6918-d260-4c20-858c-44f9ff4b8585 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:23.584414 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-3b5b6918-d260-4c20-858c-44f9ff4b8585 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.151604 May 26 19:53:23.584972 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 544/1097] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:23 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:24.225135 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:53:24.225340 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Thu May 26 19:53:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 19:53:24.601696 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e4705ebd-c609-4d6b-8cdd-1d0d2394cb28 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:24.602309 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e4705ebd-c609-4d6b-8cdd-1d0d2394cb28 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:24.608980 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4705ebd-c609-4d6b-8cdd-1d0d2394cb28 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:24.609434 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4705ebd-c609-4d6b-8cdd-1d0d2394cb28 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:24.610189 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4705ebd-c609-4d6b-8cdd-1d0d2394cb28 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:24.610627 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e4705ebd-c609-4d6b-8cdd-1d0d2394cb28 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:24.745608 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e4705ebd-c609-4d6b-8cdd-1d0d2394cb28 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:24.750368 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e4705ebd-c609-4d6b-8cdd-1d0d2394cb28 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.152575 May 26 19:53:24.750947 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 554/1098] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:24 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:25.767428 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-cece30e8-3702-48b6-acab-28b0a4767a87 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:25.768037 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-cece30e8-3702-48b6-acab-28b0a4767a87 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:25.774422 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cece30e8-3702-48b6-acab-28b0a4767a87 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:25.774863 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cece30e8-3702-48b6-acab-28b0a4767a87 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:25.775642 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cece30e8-3702-48b6-acab-28b0a4767a87 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:25.776072 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-cece30e8-3702-48b6-acab-28b0a4767a87 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:25.908907 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-cece30e8-3702-48b6-acab-28b0a4767a87 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:25.916514 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-cece30e8-3702-48b6-acab-28b0a4767a87 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.152923 May 26 19:53:25.917097 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 545/1099] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:25 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:26.934334 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-94d3fda5-7f42-4e11-9197-bb6aaa6851c4 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:26.934990 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-94d3fda5-7f42-4e11-9197-bb6aaa6851c4 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:26.941597 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-94d3fda5-7f42-4e11-9197-bb6aaa6851c4 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:26.942044 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-94d3fda5-7f42-4e11-9197-bb6aaa6851c4 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:26.942805 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-94d3fda5-7f42-4e11-9197-bb6aaa6851c4 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:26.943279 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-94d3fda5-7f42-4e11-9197-bb6aaa6851c4 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:27.069991 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-94d3fda5-7f42-4e11-9197-bb6aaa6851c4 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:27.077479 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-94d3fda5-7f42-4e11-9197-bb6aaa6851c4 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.147707 May 26 19:53:27.078041 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 555/1100] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:26 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:28.100149 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0e9a3714-3e82-41a1-bc5b-db2201fbe196 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:28.100756 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0e9a3714-3e82-41a1-bc5b-db2201fbe196 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:28.107374 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e9a3714-3e82-41a1-bc5b-db2201fbe196 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:28.107823 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e9a3714-3e82-41a1-bc5b-db2201fbe196 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:28.108657 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e9a3714-3e82-41a1-bc5b-db2201fbe196 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:28.109027 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0e9a3714-3e82-41a1-bc5b-db2201fbe196 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:28.305803 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0e9a3714-3e82-41a1-bc5b-db2201fbe196 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:28.313325 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0e9a3714-3e82-41a1-bc5b-db2201fbe196 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.222319 May 26 19:53:28.313885 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 546/1101] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:28 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:29.330445 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1980dd9c-5fbf-4bd5-b796-1a9028fd7b90 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:29.331081 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1980dd9c-5fbf-4bd5-b796-1a9028fd7b90 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:29.337700 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1980dd9c-5fbf-4bd5-b796-1a9028fd7b90 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:29.338148 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1980dd9c-5fbf-4bd5-b796-1a9028fd7b90 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:29.338921 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1980dd9c-5fbf-4bd5-b796-1a9028fd7b90 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:29.339363 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1980dd9c-5fbf-4bd5-b796-1a9028fd7b90 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:29.472336 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1980dd9c-5fbf-4bd5-b796-1a9028fd7b90 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:29.479844 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1980dd9c-5fbf-4bd5-b796-1a9028fd7b90 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.153298 May 26 19:53:29.480964 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 556/1102] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:29 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:30.498208 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-82f33562-4f7f-4eb5-a4af-2083dee0bc17 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:30.498745 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-82f33562-4f7f-4eb5-a4af-2083dee0bc17 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:30.505202 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-82f33562-4f7f-4eb5-a4af-2083dee0bc17 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:30.505652 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-82f33562-4f7f-4eb5-a4af-2083dee0bc17 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:30.506407 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-82f33562-4f7f-4eb5-a4af-2083dee0bc17 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:30.506846 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-82f33562-4f7f-4eb5-a4af-2083dee0bc17 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:30.643675 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-82f33562-4f7f-4eb5-a4af-2083dee0bc17 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:30.651155 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-82f33562-4f7f-4eb5-a4af-2083dee0bc17 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.157694 May 26 19:53:30.661552 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 547/1103] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:30 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:31.667949 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-2d5fc0d8-32b3-4479-8f62-13254ac5a00f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:31.668532 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-2d5fc0d8-32b3-4479-8f62-13254ac5a00f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:31.674992 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2d5fc0d8-32b3-4479-8f62-13254ac5a00f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:31.675495 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2d5fc0d8-32b3-4479-8f62-13254ac5a00f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:31.676216 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2d5fc0d8-32b3-4479-8f62-13254ac5a00f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:31.676654 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-2d5fc0d8-32b3-4479-8f62-13254ac5a00f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:31.804854 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-2d5fc0d8-32b3-4479-8f62-13254ac5a00f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:31.812823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-2d5fc0d8-32b3-4479-8f62-13254ac5a00f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1510 microversion: 2.1 time: 0.148861 May 26 19:53:31.813388 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 557/1104] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:31 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:31.829479 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-bcbbf95d-a32a-4e0d-ac19-73ecee86b24c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:53:31.830045 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-bcbbf95d-a32a-4e0d-ac19-73ecee86b24c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:31.836452 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bcbbf95d-a32a-4e0d-ac19-73ecee86b24c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:31.836904 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bcbbf95d-a32a-4e0d-ac19-73ecee86b24c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:31.837660 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bcbbf95d-a32a-4e0d-ac19-73ecee86b24c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:31.838099 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-bcbbf95d-a32a-4e0d-ac19-73ecee86b24c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:32.135588 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bcbbf95d-a32a-4e0d-ac19-73ecee86b24c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [620f8704-79bb-409e-86e3-41dbf283fa07] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 19:53:33.143098 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO oslo.messaging._drivers.impl_rabbit [None req-bcbbf95d-a32a-4e0d-ac19-73ecee86b24c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [620f8704-79bb-409e-86e3-41dbf283fa07] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 57548. May 26 19:53:33.146783 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-bcbbf95d-a32a-4e0d-ac19-73ecee86b24c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "POST /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22/action" status: 202 len: 0 microversion: 2.1 time: 1.321205 May 26 19:53:33.147432 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 548/1105] 10.222.0.72 () {60 vars in 1277 bytes} [Thu May 26 19:53:31 2022] POST /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22/action => generated 0 bytes in 1322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 19:53:33.156022 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-129eab53-4673-4591-8905-212a988bcf6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:33.156663 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-129eab53-4673-4591-8905-212a988bcf6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:33.163131 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-129eab53-4673-4591-8905-212a988bcf6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:33.163579 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-129eab53-4673-4591-8905-212a988bcf6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:33.164574 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-129eab53-4673-4591-8905-212a988bcf6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:33.165022 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-129eab53-4673-4591-8905-212a988bcf6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:33.298002 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-129eab53-4673-4591-8905-212a988bcf6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:33.307051 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-129eab53-4673-4591-8905-212a988bcf6a tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1518 microversion: 2.1 time: 0.155495 May 26 19:53:33.308300 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 558/1106] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:33 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:34.296586 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-5702b1fb-e2bc-40f8-9664-3f735ad95ff8 req-471d2ddc-7238-4398-a969-070a29c7a96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d513a87-789f-41b6-91b0-b5a3624aae22", "name": "network-vif-unplugged", "status": "completed", "tag": "a225d11b-f3f0-40f4-a4be-e42546652b57"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:53:34.305858 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-5702b1fb-e2bc-40f8-9664-3f735ad95ff8 req-471d2ddc-7238-4398-a969-070a29c7a96a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:34.306305 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-5702b1fb-e2bc-40f8-9664-3f735ad95ff8 req-471d2ddc-7238-4398-a969-070a29c7a96a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:34.321470 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.compute.server_external_events [req-5702b1fb-e2bc-40f8-9664-3f735ad95ff8 req-471d2ddc-7238-4398-a969-070a29c7a96a service nova] Unable to find a host for instance 0d513a87-789f-41b6-91b0-b5a3624aae22. Dropping event network-vif-unplugged {{(pid=124877) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 19:53:34.321470 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-5702b1fb-e2bc-40f8-9664-3f735ad95ff8 req-471d2ddc-7238-4398-a969-070a29c7a96a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.084169 May 26 19:53:34.321470 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 549/1107] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 85 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 19:53:34.325092 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-c51c7071-b2c6-4469-9642-b080e1b0b046 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:34.325701 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-c51c7071-b2c6-4469-9642-b080e1b0b046 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:34.332236 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c51c7071-b2c6-4469-9642-b080e1b0b046 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:34.332695 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c51c7071-b2c6-4469-9642-b080e1b0b046 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:34.333482 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c51c7071-b2c6-4469-9642-b080e1b0b046 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:34.333914 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-c51c7071-b2c6-4469-9642-b080e1b0b046 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:34.469875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-c51c7071-b2c6-4469-9642-b080e1b0b046 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:34.477468 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-c51c7071-b2c6-4469-9642-b080e1b0b046 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1518 microversion: 2.1 time: 0.156334 May 26 19:53:34.482094 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 559/1108] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:34 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:35.495847 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-0ecf8990-577f-45e3-a072-9efbbe8e43f3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:35.496407 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-0ecf8990-577f-45e3-a072-9efbbe8e43f3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:35.503082 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0ecf8990-577f-45e3-a072-9efbbe8e43f3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:35.503515 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0ecf8990-577f-45e3-a072-9efbbe8e43f3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:35.504273 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0ecf8990-577f-45e3-a072-9efbbe8e43f3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:35.504705 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-0ecf8990-577f-45e3-a072-9efbbe8e43f3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:35.637763 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-0ecf8990-577f-45e3-a072-9efbbe8e43f3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:35.645257 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-0ecf8990-577f-45e3-a072-9efbbe8e43f3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1520 microversion: 2.1 time: 0.153416 May 26 19:53:35.645819 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 550/1109] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:35 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:36.662581 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1d048750-299c-4d27-ba70-fb9f2ea06a8f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:36.663193 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1d048750-299c-4d27-ba70-fb9f2ea06a8f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:36.669883 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1d048750-299c-4d27-ba70-fb9f2ea06a8f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:36.670332 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1d048750-299c-4d27-ba70-fb9f2ea06a8f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:36.671132 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1d048750-299c-4d27-ba70-fb9f2ea06a8f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:36.671564 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1d048750-299c-4d27-ba70-fb9f2ea06a8f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:36.801342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1d048750-299c-4d27-ba70-fb9f2ea06a8f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:36.809360 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1d048750-299c-4d27-ba70-fb9f2ea06a8f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.150638 May 26 19:53:36.812109 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 560/1110] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:36 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:37.826311 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-63046809-a173-4a07-ac8d-010a1269f7a0 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:37.826972 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-63046809-a173-4a07-ac8d-010a1269f7a0 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:37.833459 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63046809-a173-4a07-ac8d-010a1269f7a0 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:37.833907 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63046809-a173-4a07-ac8d-010a1269f7a0 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:37.834662 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63046809-a173-4a07-ac8d-010a1269f7a0 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:37.835127 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-63046809-a173-4a07-ac8d-010a1269f7a0 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:37.967698 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-63046809-a173-4a07-ac8d-010a1269f7a0 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:37.975175 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-63046809-a173-4a07-ac8d-010a1269f7a0 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.152680 May 26 19:53:37.975738 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 551/1111] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:37 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:38.992458 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-e2a51c7a-ede0-4f26-9586-fe8148bc1533 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:38.993065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-e2a51c7a-ede0-4f26-9586-fe8148bc1533 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:39.000476 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e2a51c7a-ede0-4f26-9586-fe8148bc1533 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:39.000917 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e2a51c7a-ede0-4f26-9586-fe8148bc1533 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:39.001676 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e2a51c7a-ede0-4f26-9586-fe8148bc1533 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:39.002105 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-e2a51c7a-ede0-4f26-9586-fe8148bc1533 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:39.147016 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-e2a51c7a-ede0-4f26-9586-fe8148bc1533 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:39.155117 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-e2a51c7a-ede0-4f26-9586-fe8148bc1533 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.166504 May 26 19:53:39.155683 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 561/1112] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:38 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:40.172212 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-6bd7f966-3058-4222-b6ff-3c4429319ea3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:40.172765 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-6bd7f966-3058-4222-b6ff-3c4429319ea3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:40.179451 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bd7f966-3058-4222-b6ff-3c4429319ea3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:40.179906 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bd7f966-3058-4222-b6ff-3c4429319ea3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:40.180671 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bd7f966-3058-4222-b6ff-3c4429319ea3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:40.181114 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-6bd7f966-3058-4222-b6ff-3c4429319ea3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:40.312735 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-6bd7f966-3058-4222-b6ff-3c4429319ea3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:40.320238 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-6bd7f966-3058-4222-b6ff-3c4429319ea3 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.151936 May 26 19:53:40.320800 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 552/1113] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:40 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:41.337431 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-ac26b6db-9308-42c2-9ebc-bab6c5d278f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:41.338065 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-ac26b6db-9308-42c2-9ebc-bab6c5d278f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:41.345161 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ac26b6db-9308-42c2-9ebc-bab6c5d278f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:41.345613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ac26b6db-9308-42c2-9ebc-bab6c5d278f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:41.346373 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ac26b6db-9308-42c2-9ebc-bab6c5d278f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:41.346813 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-ac26b6db-9308-42c2-9ebc-bab6c5d278f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:41.475357 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-ac26b6db-9308-42c2-9ebc-bab6c5d278f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:41.483413 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-ac26b6db-9308-42c2-9ebc-bab6c5d278f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.149819 May 26 19:53:41.483982 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 562/1114] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:41 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:42.502000 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-339b3a3f-3278-41c5-8f7d-c392d7c0863f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:42.502613 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-339b3a3f-3278-41c5-8f7d-c392d7c0863f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:42.508859 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-339b3a3f-3278-41c5-8f7d-c392d7c0863f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:42.509300 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-339b3a3f-3278-41c5-8f7d-c392d7c0863f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:42.510045 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-339b3a3f-3278-41c5-8f7d-c392d7c0863f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:42.510476 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-339b3a3f-3278-41c5-8f7d-c392d7c0863f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:42.628342 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:53:42.628926 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Thu May 26 19:53:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 19:53:42.891866 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-339b3a3f-3278-41c5-8f7d-c392d7c0863f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:42.899416 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-339b3a3f-3278-41c5-8f7d-c392d7c0863f tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.401724 May 26 19:53:42.899995 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 553/1115] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:42 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:43.916908 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-f521bee5-d637-421f-a335-7e69d9d977f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:43.917514 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-f521bee5-d637-421f-a335-7e69d9d977f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:43.924050 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f521bee5-d637-421f-a335-7e69d9d977f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:43.927804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f521bee5-d637-421f-a335-7e69d9d977f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:43.927804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f521bee5-d637-421f-a335-7e69d9d977f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:43.927804 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-f521bee5-d637-421f-a335-7e69d9d977f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:44.076598 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-f521bee5-d637-421f-a335-7e69d9d977f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:44.084090 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-f521bee5-d637-421f-a335-7e69d9d977f5 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.171166 May 26 19:53:44.084653 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 563/1116] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:43 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:45.101479 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-fb2b5635-f744-4549-be41-8a9629930c34 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:45.102054 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-fb2b5635-f744-4549-be41-8a9629930c34 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:45.109003 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb2b5635-f744-4549-be41-8a9629930c34 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:45.109444 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb2b5635-f744-4549-be41-8a9629930c34 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:45.110185 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb2b5635-f744-4549-be41-8a9629930c34 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:45.110612 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-fb2b5635-f744-4549-be41-8a9629930c34 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:45.237779 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-fb2b5635-f744-4549-be41-8a9629930c34 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:45.245138 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-fb2b5635-f744-4549-be41-8a9629930c34 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.147540 May 26 19:53:45.245696 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 554/1117] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:45 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:46.261800 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-0a44cd5a-8e6a-4646-9147-41639158ccf1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:46.262444 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-0a44cd5a-8e6a-4646-9147-41639158ccf1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:46.269440 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0a44cd5a-8e6a-4646-9147-41639158ccf1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:46.269902 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0a44cd5a-8e6a-4646-9147-41639158ccf1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:46.270666 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0a44cd5a-8e6a-4646-9147-41639158ccf1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:46.271131 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-0a44cd5a-8e6a-4646-9147-41639158ccf1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:46.329121 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-80c6e921-a117-41fa-b94e-47ae0a95baaa req-ebcc47ce-348c-4707-9e26-4b86112435fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d513a87-789f-41b6-91b0-b5a3624aae22", "name": "network-vif-plugged", "status": "completed", "tag": "a225d11b-f3f0-40f4-a4be-e42546652b57"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:53:46.339414 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-80c6e921-a117-41fa-b94e-47ae0a95baaa req-ebcc47ce-348c-4707-9e26-4b86112435fd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:46.344726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-80c6e921-a117-41fa-b94e-47ae0a95baaa req-ebcc47ce-348c-4707-9e26-4b86112435fd service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:46.344726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:46.350894 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-80c6e921-a117-41fa-b94e-47ae0a95baaa req-ebcc47ce-348c-4707-9e26-4b86112435fd service nova] Creating event network-vif-plugged:a225d11b-f3f0-40f4-a4be-e42546652b57 for instance 0d513a87-789f-41b6-91b0-b5a3624aae22 on hv-cinder-82549 May 26 19:53:46.357564 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-80c6e921-a117-41fa-b94e-47ae0a95baaa req-ebcc47ce-348c-4707-9e26-4b86112435fd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032624 May 26 19:53:46.358175 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 555/1118] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 19:53:46.410949 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-0a44cd5a-8e6a-4646-9147-41639158ccf1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:46.418436 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-0a44cd5a-8e6a-4646-9147-41639158ccf1 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.160798 May 26 19:53:46.419225 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 564/1119] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:46 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:47.437911 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-50434f45-0d2b-4901-bf62-67756da5143c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:47.438636 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-50434f45-0d2b-4901-bf62-67756da5143c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:47.440522 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=33 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:47.445801 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-50434f45-0d2b-4901-bf62-67756da5143c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:47.446249 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-50434f45-0d2b-4901-bf62-67756da5143c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:47.447031 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-50434f45-0d2b-4901-bf62-67756da5143c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:47.447470 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-50434f45-0d2b-4901-bf62-67756da5143c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:47.576556 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-50434f45-0d2b-4901-bf62-67756da5143c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:47.584780 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-50434f45-0d2b-4901-bf62-67756da5143c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1576 microversion: 2.1 time: 0.151872 May 26 19:53:47.585353 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 556/1120] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:47 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:48.601898 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-08900919-c02d-4f3d-a056-b3b42b09125d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:53:48.602501 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-08900919-c02d-4f3d-a056-b3b42b09125d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:53:48.604794 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=29 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:48.609573 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-08900919-c02d-4f3d-a056-b3b42b09125d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:48.612823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-08900919-c02d-4f3d-a056-b3b42b09125d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:48.612823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-08900919-c02d-4f3d-a056-b3b42b09125d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:53:48.612823 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-08900919-c02d-4f3d-a056-b3b42b09125d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:53:48.615603 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=85 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:48.745452 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-08900919-c02d-4f3d-a056-b3b42b09125d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:53:48.753090 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-08900919-c02d-4f3d-a056-b3b42b09125d tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1563 microversion: 2.1 time: 0.155095 May 26 19:53:48.753646 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 565/1121] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:53:48 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:53:56.065134 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:53:56.065697 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Thu May 26 19:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 19:54:04.201408 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:54:04.202220 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Thu May 26 19:54:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 19:55:08.163874 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_api:SELECT=1 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:55:08.164618 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG dbcounter [-] [124877] Writing DB stats nova_cell1:SELECT=6 {{(pid=124877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:55:08.168538 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-4051d6fb-0f32-45f0-bdc5-daf055521e4b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:55:08.173867 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4051d6fb-0f32-45f0-bdc5-daf055521e4b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:55:08.174016 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_api:SELECT=1 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:55:08.174016 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG dbcounter [-] [124876] Writing DB stats nova_cell1:SELECT=5 {{(pid=124876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:55:08.176122 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4051d6fb-0f32-45f0-bdc5-daf055521e4b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:08.176573 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4051d6fb-0f32-45f0-bdc5-daf055521e4b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:08.177586 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4051d6fb-0f32-45f0-bdc5-daf055521e4b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:08.178193 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-4051d6fb-0f32-45f0-bdc5-daf055521e4b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:08.209265 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-4051d6fb-0f32-45f0-bdc5-daf055521e4b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Going to try to terminate instance {{(pid=124877) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 19:55:08.235147 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [req-efac9971-e283-4035-8fbc-5a90f39a74ee req-f3b0b790-6022-4399-8e2f-769017fda53a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d513a87-789f-41b6-91b0-b5a3624aae22", "tag": "a225d11b-f3f0-40f4-a4be-e42546652b57"}]} {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:55:08.242987 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-efac9971-e283-4035-8fbc-5a90f39a74ee req-f3b0b790-6022-4399-8e2f-769017fda53a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:08.243426 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [req-efac9971-e283-4035-8fbc-5a90f39a74ee req-f3b0b790-6022-4399-8e2f-769017fda53a service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:08.255724 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.compute.server_external_events [req-efac9971-e283-4035-8fbc-5a90f39a74ee req-f3b0b790-6022-4399-8e2f-769017fda53a service nova] Creating event network-changed:a225d11b-f3f0-40f4-a4be-e42546652b57 for instance 0d513a87-789f-41b6-91b0-b5a3624aae22 on hv-cinder-82549 May 26 19:55:08.261745 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [req-efac9971-e283-4035-8fbc-5a90f39a74ee req-f3b0b790-6022-4399-8e2f-769017fda53a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092914 May 26 19:55:08.262339 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 566/1122] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:55:08.476629 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-4051d6fb-0f32-45f0-bdc5-daf055521e4b tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 204 len: 0 microversion: 2.1 time: 0.314214 May 26 19:55:08.477231 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 557/1123] 10.222.0.72 () {58 vars in 1238 bytes} [Thu May 26 19:55:08 2022] DELETE /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 19:55:08.486613 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-58d60602-1534-4dac-afaa-789759657b1c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:55:08.487707 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-58d60602-1534-4dac-afaa-789759657b1c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:55:08.495174 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58d60602-1534-4dac-afaa-789759657b1c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:08.495727 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58d60602-1534-4dac-afaa-789759657b1c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:08.496557 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58d60602-1534-4dac-afaa-789759657b1c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:08.497057 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-58d60602-1534-4dac-afaa-789759657b1c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:08.640315 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-58d60602-1534-4dac-afaa-789759657b1c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:55:08.648455 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-58d60602-1534-4dac-afaa-789759657b1c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.166184 May 26 19:55:08.653626 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 567/1124] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:55:08 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:55:09.665842 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-ab766c33-7cab-4f2f-b495-76d0432bd6b2 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:55:09.666548 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-ab766c33-7cab-4f2f-b495-76d0432bd6b2 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:55:09.673175 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ab766c33-7cab-4f2f-b495-76d0432bd6b2 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:09.673629 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ab766c33-7cab-4f2f-b495-76d0432bd6b2 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:09.674421 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ab766c33-7cab-4f2f-b495-76d0432bd6b2 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:09.674862 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-ab766c33-7cab-4f2f-b495-76d0432bd6b2 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:09.817717 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.policy [None req-ab766c33-7cab-4f2f-b495-76d0432bd6b2 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124877) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:55:09.825220 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-ab766c33-7cab-4f2f-b495-76d0432bd6b2 tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1569 microversion: 2.1 time: 0.163616 May 26 19:55:09.825794 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 558/1125] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:55:09 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:55:10.841529 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-35e5a1b4-1e58-4362-9bf2-2d4a897037bc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:55:10.842174 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-35e5a1b4-1e58-4362-9bf2-2d4a897037bc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:55:10.848867 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-35e5a1b4-1e58-4362-9bf2-2d4a897037bc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:10.849337 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-35e5a1b4-1e58-4362-9bf2-2d4a897037bc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:10.850096 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-35e5a1b4-1e58-4362-9bf2-2d4a897037bc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:10.850555 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-35e5a1b4-1e58-4362-9bf2-2d4a897037bc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:10.984278 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-35e5a1b4-1e58-4362-9bf2-2d4a897037bc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:55:10.991857 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-35e5a1b4-1e58-4362-9bf2-2d4a897037bc tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1450 microversion: 2.1 time: 0.154251 May 26 19:55:10.992421 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 568/1126] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:55:10 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:55:11.144561 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [req-07911621-b172-4b5a-9d07-d59235a33d3f req-21eb22e1-4893-42f9-a867-9cb344a9011c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d513a87-789f-41b6-91b0-b5a3624aae22", "name": "network-vif-deleted", "tag": "a225d11b-f3f0-40f4-a4be-e42546652b57"}]} {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 19:55:11.152888 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-07911621-b172-4b5a-9d07-d59235a33d3f req-21eb22e1-4893-42f9-a867-9cb344a9011c service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:11.153328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [req-07911621-b172-4b5a-9d07-d59235a33d3f req-21eb22e1-4893-42f9-a867-9cb344a9011c service nova] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:11.164586 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.compute.server_external_events [req-07911621-b172-4b5a-9d07-d59235a33d3f req-21eb22e1-4893-42f9-a867-9cb344a9011c service nova] Creating event network-vif-deleted:a225d11b-f3f0-40f4-a4be-e42546652b57 for instance 0d513a87-789f-41b6-91b0-b5a3624aae22 on hv-cinder-82549 May 26 19:55:11.169670 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [req-07911621-b172-4b5a-9d07-d59235a33d3f req-21eb22e1-4893-42f9-a867-9cb344a9011c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028910 May 26 19:55:11.170292 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 559/1127] 10.222.0.72 () {64 vars in 1317 bytes} [Thu May 26 19:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 19:55:12.008563 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:55:12.009125 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.compute.api [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124876) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:55:12.015801 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:12.016251 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:12.017066 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:12.017502 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:12.051112 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:12.051562 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG oslo_concurrency.lockutils [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:12.052005 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.objects.instance [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lazy-loading 'fault' on Instance uuid 0d513a87-789f-41b6-91b0-b5a3624aae22 {{(pid=124876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 19:55:12.093681 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.policy [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ae36aaeb224d0984a4ff88f15545db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b321ef1c40e0427fb5ea28acac45322b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124876) authorize /opt/stack/nova/nova/policy.py:199}} May 26 19:55:12.101099 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-1445cd84-0c59-42e1-961b-fdbb33781bff tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 200 len: 1224 microversion: 2.1 time: 0.096509 May 26 19:55:12.101657 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 569/1128] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:55:12 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 19:55:13.119600 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '>' {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:55:13.120324 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.compute.api [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] [instance: 0d513a87-789f-41b6-91b0-b5a3624aae22] Fetching instance by UUID {{(pid=124877) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 19:55:13.127468 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:13.127918 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:13.128674 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 19:55:13.129112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG oslo_concurrency.lockutils [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Lock "e1f15ba6-4bbf-4710-a76f-47f056c03285" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 19:55:13.142112 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.wsgi [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] HTTP exception thrown: Instance 0d513a87-789f-41b6-91b0-b5a3624aae22 could not be found. May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Request method failure captured: May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: request: GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 HTTP/1.1 May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept: application/json May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Accept-Encoding: identity May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Connection: close May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Length: 0 May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Content-Type: application/json May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Host: 10.222.0.72 May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Openstack-System-Scope: None May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: User-Agent: python-urllib3/1.26.9 May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Auth-Token: gAAAAABij9oLDUvRqdtxiJN51JY4YKG00Qq3TercEvaktKmqb920frNR2Vp1EOhjPnfbvrWVZQHaL8XGqFbyqK4l99_AIC-VKV4J-HPWsePTqifWwlOfAAcSRet7JOR9KdYNeg-YTbXTPcn4oXXB2NmgVk2pTaGIfWNcEh1zXBMQBZYr5Eq1zCw May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Id: None May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Domain-Name: None May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Identity-Status: Confirmed May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Is-Admin-Project: True May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Id: default May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Domain-Name: Default May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Id: b321ef1c40e0427fb5ea28acac45322b May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Project-Name: tempest-TestShelveInstance-1538287486 May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Role: member,reader May 26 19:55:13.143726 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Roles: member,reader May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b321ef1c40e0427fb5ea28acac45322b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b321ef1c40e0427fb5ea28acac45322b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b321ef1c40e0427fb5ea28acac45322b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b321ef1c40e0427fb5ea28acac45322b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}] May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant: tempest-TestShelveInstance-1538287486 May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Id: b321ef1c40e0427fb5ea28acac45322b May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-Tenant-Name: tempest-TestShelveInstance-1538287486 May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User: tempest-TestShelveInstance-1538287486-project May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Id: default May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Domain-Name: Default May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Id: 31ae36aaeb224d0984a4ff88f15545db May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: X-User-Name: tempest-TestShelveInstance-1538287486-project May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: method: > May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: exception: Instance 0d513a87-789f-41b6-91b0-b5a3624aae22 could not be found. May 26 19:55:13.145381 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: action_args: {'id': '0d513a87-789f-41b6-91b0-b5a3624aae22'} May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: {{(pid=124877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d513a87-789f-41b6-91b0-b5a3624aae22 could not be found. May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 19:55:13.146574 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d513a87-789f-41b6-91b0-b5a3624aae22 could not be found. May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d513a87-789f-41b6-91b0-b5a3624aae22 could not be found. May 26 19:55:13.148494 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: ERROR nova.api.openstack.wsgi May 26 19:55:13.150049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: DEBUG nova.api.openstack.wsgi [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Returning 404 to user: Instance 0d513a87-789f-41b6-91b0-b5a3624aae22 could not be found. {{(pid=124877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 19:55:13.150049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO nova.api.openstack.requestlog [None req-14d1b5f6-b198-4f64-ba93-ff2b40ddbe4e tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22" status: 404 len: 111 microversion: 2.1 time: 0.030220 May 26 19:55:13.150049 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: [pid: 124877|app: 0|req: 560/1129] 10.222.0.72 () {58 vars in 1235 bytes} [Thu May 26 19:55:13 2022] GET /compute/v2.1/servers/0d513a87-789f-41b6-91b0-b5a3624aae22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 19:55:13.369670 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: DEBUG nova.api.openstack.wsgi [None req-519f6c36-9d10-4ac5-85ac-50dcf776329c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] Calling method '.version_select at 0x7fa7880ede50>' {{(pid=124876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 19:55:13.431984 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO nova.api.openstack.requestlog [None req-519f6c36-9d10-4ac5-85ac-50dcf776329c tempest-TestShelveInstance-1538287486 tempest-TestShelveInstance-1538287486-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-871265355" status: 202 len: 0 microversion: 2.1 time: 0.067640 May 26 19:55:13.432564 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: [pid: 124876|app: 0|req: 570/1130] 10.222.0.72 () {58 vars in 1250 bytes} [Thu May 26 19:55:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-871265355 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 19:56:44.233763 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:56:44.234368 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Thu May 26 19:56:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 19:57:15.811653 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:57:15.812274 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Thu May 26 19:57:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 19:57:16.073371 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:57:16.073875 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Thu May 26 19:57:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 19:58:39.172328 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 19:58:39.172966 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Thu May 26 19:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:00:04.242420 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:00:04.247134 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Thu May 26 20:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:00:22.641283 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:00:22.641888 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Thu May 26 20:00:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:00:35.820350 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:00:35.821439 dv-cinder-825492-17-iscsi devstack@n-api.service[124877]: Thu May 26 20:00:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:00:36.081145 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:00:36.081680 dv-cinder-825492-17-iscsi devstack@n-api.service[124876]: Thu May 26 20:00:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!